Nov 03 08:07:56 devstack cinder-volume[75792]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 08:07:56 devstack cinder-volume[75792]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 08:07:56 devstack cinder-volume[75792]: we strongly recommend against using it for new projects. Nov 03 08:07:56 devstack cinder-volume[75792]: If you are already using Eventlet, we recommend migrating to a different Nov 03 08:07:56 devstack cinder-volume[75792]: framework. For more detail see Nov 03 08:07:56 devstack cinder-volume[75792]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 08:07:56 devstack cinder-volume[75792]: import eventlet # noqa Nov 03 08:07:59 devstack cinder-volume[75792]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75792) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 08:07:59 devstack cinder-volume[75792]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75792) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 08:07:59 devstack cinder-volume[75792]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75792) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 08:07:59 devstack cinder-volume[75792]: INFO dbcounter [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Registered counter for database cinder Nov 03 08:08:00 devstack cinder-volume[75792]: DEBUG oslo_db.sqlalchemy.engines [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75792) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 08:08:00 devstack cinder-volume[75792]: DEBUG dbcounter [-] [75792] Writer thread running {{(pid=75792) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 08:08:00 devstack cinder-volume[75792]: INFO cinder.rpc [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 08:08:00 devstack cinder-volume[75792]: INFO cinder.rpc [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 08:08:00 devstack cinder-volume[75792]: DEBUG oslo_db.sqlalchemy.engines [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75792) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 08:08:00 devstack cinder-volume[75792]: INFO cinder.volume.manager [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Determined volume DB was empty at startup. Nov 03 08:08:00 devstack cinder-volume[75792]: DEBUG cinder.volume.manager [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75792) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 08:08:00 devstack cinder-volume[75792]: INFO cinder.volume.manager [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 03 08:08:00 devstack cinder-volume[75792]: WARNING stevedore.named [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 08:08:00 devstack cinder-volume[75792]: WARNING castellan.key_manager [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 08:08:00 devstack cinder-volume[75792]: WARNING cinder.keymgr.conf_key_mgr [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 08:08:00 devstack cinder-volume[75792]: DEBUG cinder.volume.drivers.lvm [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75792) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 03 08:08:00 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] CMD "cinder-rtstool verify" returned: 0 in 0.442s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_db.sqlalchemy.engines [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75792) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 08:08:01 devstack cinder-volume[75792]: INFO cinder.rpc [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 03 08:08:01 devstack cinder-volume[75792]: INFO cinder.rpc [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 03 08:08:01 devstack cinder-volume[75792]: WARNING stevedore.named [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 08:08:01 devstack cinder-volume[75792]: WARNING castellan.key_manager [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 08:08:01 devstack cinder-volume[75792]: INFO cinder.volume.manager [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_db.sqlalchemy.engines [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75792) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 08:08:01 devstack cinder-volume[75792]: INFO oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Starting 1 workers Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Started child 75949 {{(pid=75792) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Full set of CONF: {{(pid=75792) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] ******************************************************************************** {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Configuration options gathered from: {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 08:08:01 devstack cinder-volume[75949]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] ================================================================================ {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] allow_availability_zone_fallback = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] allow_compression_on_image_upload = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] allowed_direct_url_schemes = [] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] api_rate_limit = True {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] auth_strategy = keystone {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] az_cache_duration = 3600 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_availability_zone = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_host = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_name = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_stats_polling_interval = 60 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backup_api_class = cinder.backup.api.API {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backup_name_template = backup-%s {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backup_use_same_host = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backup_use_temp_snapshot = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] chap_password = **** {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] chap_username = {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cinder_internal_tenant_project_id = 824b57911041451f9c5eb73c2e42cb9f {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cinder_internal_tenant_user_id = e38a97466db24a5a932294c6d1dbd4ff {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cloned_volume_same_az = True {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cluster = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] compression_format = gzip {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] compute_api_class = cinder.compute.nova.API {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] config_dir = [] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] config_source = [] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] control_exchange = openstack {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] debug = True {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] default_availability_zone = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] default_group_type = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] default_volume_type = lvmdriver-1 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] disk_geometry = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] driver_client_cert = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] driver_client_cert_key = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] driver_data_namespace = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] driver_ssl_cert_path = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] driver_ssl_cert_verify = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] driver_use_ssl = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] enable_force_upload = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] enable_new_services = True {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] enable_unsupported_driver = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] enforce_multipath_for_image_xfer = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75949]: INFO cinder.volume.manager [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 03 08:08:01 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] filter_function = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] glance_api_insecure = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] glance_api_servers = ['http://192.168.122.104/image'] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] glance_api_ssl_compression = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] glance_ca_certificates_file = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] glance_catalog_info = image:glance:publicURL {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] glance_certfile = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] glance_keyfile = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] glance_num_retries = 3 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] glance_request_timeout = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] goodness_function = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] graceful_shutdown_timeout = 5 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] group_api_class = cinder.group.api.API {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] host = devstack {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] image_compress_on_upload = True {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] image_conversion_address_space_limit = 1 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] image_conversion_cpu_limit = 60 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] image_conversion_disable = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] image_introspection_address_space_limit = 1 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] image_introspection_cpu_limit = 60 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] image_upload_use_cinder_backend = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] image_upload_use_internal_tenant = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] image_volume_cache_enabled = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] image_volume_cache_max_count = 0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] image_volume_cache_max_size_gb = 0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] init_host_max_objects_retrieval = 0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] instance_format = [instance: %(uuid)s] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:01 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] iscsi_target_flags = {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] iscsi_write_cache = on {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] iser_helper = tgtadm {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] iser_ip_address = 192.168.122.104 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] iser_port = 3260 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] log_color = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] log_config_append = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] log_dir = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] log_file = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] log_options = True {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] log_rotate_interval = 1 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] log_rotate_interval_type = days {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] log_rotation_type = none {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] max_age = 0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] max_logfile_count = 30 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] max_logfile_size_mb = 200 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] max_over_subscription_ratio = 20.0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] message_reap_interval = 86400 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] message_ttl = 2592000 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] migration_create_volume_timeout_secs = 300 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] monkey_patch = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] monkey_patch_modules = [] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] my_ip = 192.168.122.104 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] no_snapshot_gb_quota = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] num_iser_scan_tries = 3 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] num_shell_tries = 3 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] num_volume_device_scan_tries = 3 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] nvmeof_conn_info_version = 1 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] nvmet_ns_id = 10 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] nvmet_port_id = 1 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] osapi_max_limit = 1000 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] osapi_volume_ext_list = [] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] osapi_volume_listen_port = 8776 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] osapi_volume_use_ssl = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] osapi_volume_workers = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] per_volume_size_limit = -1 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] periodic_fuzzy_delay = 60 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] periodic_interval = 60 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] public_endpoint = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] publish_errors = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] quota_backup_gigabytes = 1000 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:01 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] quota_backups = 10 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] quota_gigabytes = 1000 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] quota_groups = 10 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] quota_snapshots = 10 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] quota_volumes = 10 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] rate_limit_burst = 0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] rate_limit_except_level = CRITICAL {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] rate_limit_interval = 0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] reinit_driver_count = 3 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] replication_device = **** {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] report_discard_supported = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] report_interval = 120 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] reservation_clean_interval = 86400 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] reservation_expire = 86400 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] reserved_image_namespaces = [] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] reserved_percentage = 0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] rpc_response_timeout = 120 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] run_external_periodic_tasks = True {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] scst_target_driver = iscsi {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] scst_target_iqn_name = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] service_down_time = 720 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] shell_completion = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] snapshot_name_template = snapshot-%s {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] snapshot_same_host = True {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] split_loggers = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] state_path = /opt/stack/data/cinder {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] storage_availability_zone = nova {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] storage_protocol = iSCSI {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack sudo[75953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 03 08:08:01 devstack sudo[75953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] syslog_log_facility = LOG_USER {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] target_helper = lioadm {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] target_ip_address = 192.168.122.104 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] target_port = 3260 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] target_protocol = iscsi {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] target_secondary_ip_addresses = [] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] trace_flags = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] transport_url = **** {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] until_refresh = 0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] use_chap_auth = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] use_default_quota_class = True {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] use_journal = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] use_json = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] use_multipath_for_image_xfer = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] use_stderr = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] use_syslog = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] verify_glance_signatures = enabled {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] volume_api_class = cinder.volume.api.API {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] volume_backend_name = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] volume_clear = zero {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] volume_clear_ionice = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] volume_clear_size = 0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] volume_copy_bps_limit = 0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] volume_dd_blocksize = 1M {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] volume_name_template = volume-%s {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] volume_service_inithost_offload = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] volume_usage_audit_period = month {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] zoning_mode = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_concurrency.disable_process_locking = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.auth_section = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.auth_type = password {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.auth_version = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.cache = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.certfile = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.include_service_catalog = True {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.insecure = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.interface = public {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.keyfile = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.memcache_password = **** {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.memcache_username = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.region_name = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.service_type = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.104/identity {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.backend = dogpile.cache.null {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.backend_argument = **** {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.backend_expiration_time = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.config_prefix = cache.oslo {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.debug_cache_backend = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.enable_retry_client = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.enable_socket_keepalive = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.enabled = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.expiration_time = 600 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.hashclient_retry_attempts = 2 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.memcache_dead_retry = 300 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.memcache_pool_maxsize = 10 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.memcache_sasl_enabled = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.password = **** {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.proxies = [] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.redis_db = 0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.redis_server = localhost:6379 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.retry_attempts = 2 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.retry_delay = 0.0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.socket_keepalive_count = 1 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.socket_keepalive_idle = 1 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.socket_keepalive_interval = 1 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.socket_timeout = 1.0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.tls_allowed_ciphers = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.tls_cafile = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.tls_certfile = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.tls_enabled = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.tls_keyfile = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cache.username = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] coordination.backend_url = **** {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] database.asyncio_connection = **** {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] database.asyncio_slave_connection = **** {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] database.backend = sqlalchemy {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] database.connection = **** {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] database.connection_debug = 0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] database.connection_parameters = {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] database.connection_recycle_time = 3600 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] database.connection_trace = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] database.db_inc_retry_interval = True {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] database.db_max_retries = 20 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] database.db_max_retry_interval = 10 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] database.db_retry_interval = 1 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] database.max_overflow = 50 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] database.max_pool_size = 5 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] database.max_retries = 10 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] database.mysql_wsrep_sync_wait = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] database.pool_timeout = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] database.retry_interval = 10 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] database.slave_connection = **** {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] database.sqlite_synchronous = True {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] database.synchronous_reader = True {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] database.use_db_reconnect = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_tracing.insecure = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] profiler.connection_string = messaging:// {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] profiler.enabled = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] profiler.es_doc_type = notification {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] profiler.es_scroll_size = 10000 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] profiler.es_scroll_time = 2m {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] profiler.filter_error_trace = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] profiler.hmac_keys = **** {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] profiler.sentinel_service_name = mymaster {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] profiler.socket_timeout = 0.1 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] profiler.trace_requests = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] profiler.trace_sqlalchemy = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] profiler_jaeger.process_tags = {} {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] profiler_jaeger.service_name_prefix = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] profiler_otlp.service_name_prefix = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_policy.enforce_new_defaults = True {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_policy.policy_default_rule = default {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_policy.policy_file = policy.yaml {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] privsep_osbrick.group = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] privsep_osbrick.helper_command = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] privsep_osbrick.user = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cinder_sys_admin.group = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cinder_sys_admin.helper_command = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] cinder_sys_admin.user = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] service_user.auth_section = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] service_user.auth_type = password {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] service_user.cafile = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] service_user.certfile = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] service_user.collect_timing = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] service_user.insecure = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] service_user.keyfile = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] service_user.send_service_user_token = True {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] service_user.split_loggers = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] service_user.timeout = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] service_user.tls_ciphers = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] service_user.tls_min_version = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] glance.auth_section = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] glance.auth_type = password {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] glance.certfile = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] glance.collect_timing = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] glance.insecure = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] glance.keyfile = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] glance.region_name = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] glance.split_loggers = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] glance.timeout = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] glance.tls_ciphers = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] glance.tls_min_version = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.backend_availability_zone = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.chap_password = **** {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.chap_username = {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.disk_geometry = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.driver_client_cert = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.driver_client_cert_key = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.driver_data_namespace = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.driver_use_ssl = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.extra_capabilities = {} {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.filter_function = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.goodness_function = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.iscsi_target_flags = {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.iscsi_write_cache = on {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.iser_helper = tgtadm {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.iser_ip_address = 192.168.122.104 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.iser_port = 3260 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.lvm_share_target = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.lvm_type = auto {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.num_shell_tries = 3 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.replication_device = **** {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.report_discard_supported = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.reserved_percentage = 0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.target_helper = tgtadm {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.target_ip_address = 192.168.122.104 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.target_port = 3260 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.target_protocol = iscsi {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.trace_flags = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.unique_fqdn_network = True {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.use_chap_auth = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.volume_backend_name = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.volume_clear = zero {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.volume_clear_ionice = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.volume_clear_size = 0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_reports.file_event_handler = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_reports.log_dir = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.backend_host = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.chap_password = **** {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.chap_username = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.disk_geometry = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.driver_client_cert = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.extra_capabilities = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.filter_function = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.goodness_function = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.iser_helper = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.iser_ip_address = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.iser_port = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.lvm_share_target = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.lvm_type = auto {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.num_shell_tries = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.replication_device = **** {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.report_discard_supported = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.reserved_percentage = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.scst_target_driver = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.storage_protocol = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.target_helper = lioadm {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.target_ip_address = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.target_port = 3260 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.trace_flags = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.use_chap_auth = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.volume_clear = zero {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.volume_clear_size = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] lvmdriver-1.volumes_dir = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.ssl = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_notifications.driver = [] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_notifications.retry = -1 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] key_manager.fixed_key = **** {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican.barbican_api_version = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican.barbican_endpoint = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican.barbican_endpoint_type = public {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican.barbican_region_name = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican.cafile = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican.certfile = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican.collect_timing = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican.insecure = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican.keyfile = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican.number_of_retries = 60 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican.retry_delay = 1 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican.send_service_user_token = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican.split_loggers = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican.timeout = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican.tls_ciphers = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican.tls_min_version = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican.verify_ssl = True {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican.verify_ssl_path = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican_service_user.auth_section = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican_service_user.auth_type = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican_service_user.cafile = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican_service_user.certfile = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican_service_user.collect_timing = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican_service_user.insecure = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican_service_user.keyfile = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican_service_user.split_loggers = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican_service_user.timeout = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican_service_user.tls_ciphers = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] barbican_service_user.tls_min_version = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] vault.approle_role_id = **** {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] vault.approle_secret_id = **** {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] vault.auth_method = approle {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] vault.auth_path = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] vault.kv_mountpoint = secret {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] vault.kv_path = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] vault.kv_version = 2 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] vault.namespace = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] vault.root_token_id = **** {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] vault.ssl_ca_crt_file = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] vault.timeout = 60.0 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] vault.token_file = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] vault.token_role = None {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] vault.use_ssl = False {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:08:01 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] ******************************************************************************** {{(pid=75792) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 08:08:01 devstack sudo[75953]: pam_unix(sudo:session): session closed for user root Nov 03 08:08:01 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.352s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:01 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:01 devstack sudo[76044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 08:08:01 devstack sudo[76044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:08:02 devstack sudo[76044]: pam_unix(sudo:session): session closed for user root Nov 03 08:08:02 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.322s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:02 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 08:08:02 devstack cinder-volume[75949]: INFO cinder.brick.local_dev.lvm [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 03 08:08:02 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:02 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:02 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:02 devstack sudo[76149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 08:08:02 devstack sudo[76149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:08:02 devstack sudo[76149]: pam_unix(sudo:session): session closed for user root Nov 03 08:08:02 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:02 devstack cinder-volume[75949]: DEBUG cinder.brick.local_dev.lvm [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75949) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 03 08:08:02 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:02 devstack sudo[76230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 08:08:02 devstack sudo[76230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:08:02 devstack sudo[76230]: pam_unix(sudo:session): session closed for user root Nov 03 08:08:02 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.518s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:02 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:02 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:02 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:02 devstack sudo[76421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 08:08:02 devstack sudo[76421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:08:03 devstack sudo[76421]: pam_unix(sudo:session): session closed for user root Nov 03 08:08:03 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:03 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:03 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:03 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:03 devstack sudo[76491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 03 08:08:03 devstack sudo[76491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:08:03 devstack sudo[76491]: pam_unix(sudo:session): session closed for user root Nov 03 08:08:03 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.304s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:03 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:03 devstack sudo[76570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 08:08:03 devstack sudo[76570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:08:03 devstack sudo[76570]: pam_unix(sudo:session): session closed for user root Nov 03 08:08:03 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:03 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:03 devstack sudo[76578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 08:08:03 devstack sudo[76578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:08:04 devstack sudo[76578]: pam_unix(sudo:session): session closed for user root Nov 03 08:08:04 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.356s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:04 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:04 devstack sudo[76657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 08:08:04 devstack sudo[76657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:08:04 devstack sudo[76657]: pam_unix(sudo:session): session closed for user root Nov 03 08:08:04 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:04 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:04 devstack sudo[76666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 08:08:04 devstack sudo[76666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:08:04 devstack sudo[76666]: pam_unix(sudo:session): session closed for user root Nov 03 08:08:04 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.308s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:04 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:04 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:04 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:04 devstack sudo[76756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 08:08:04 devstack sudo[76756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:08:05 devstack sudo[76756]: pam_unix(sudo:session): session closed for user root Nov 03 08:08:05 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:05 devstack cinder-volume[75949]: INFO cinder.volume.drivers.lvm [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 03 08:08:05 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:05 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:05 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:05 devstack sudo[76760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 08:08:05 devstack sudo[76760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:08:05 devstack sudo[76760]: pam_unix(sudo:session): session closed for user root Nov 03 08:08:05 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.296s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:05 devstack cinder-volume[75949]: DEBUG cinder.volume.drivers.lvm [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Updating volume stats {{(pid=75949) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 08:08:05 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:05 devstack sudo[76764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 08:08:05 devstack sudo[76764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:08:05 devstack sudo[76764]: pam_unix(sudo:session): session closed for user root Nov 03 08:08:05 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:05 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:05 devstack sudo[76767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 08:08:05 devstack sudo[76767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:08:05 devstack sudo[76767]: pam_unix(sudo:session): session closed for user root Nov 03 08:08:05 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.233s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:05 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:05 devstack sudo[76770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 08:08:05 devstack sudo[76770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:08:06 devstack sudo[76770]: pam_unix(sudo:session): session closed for user root Nov 03 08:08:06 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.233s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:06 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:06 devstack sudo[76773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 08:08:06 devstack sudo[76773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:08:06 devstack sudo[76773]: pam_unix(sudo:session): session closed for user root Nov 03 08:08:06 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:06 devstack cinder-volume[75949]: INFO cinder.volume.driver [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Driver hasn't implemented _init_vendor_properties() Nov 03 08:08:06 devstack cinder-volume[75949]: DEBUG cinder.volume.driver [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75949) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 08:08:06 devstack cinder-volume[75949]: DEBUG oslo_db.sqlalchemy.engines [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75949) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 08:08:06 devstack cinder-volume[75949]: DEBUG dbcounter [-] [75949] Writer thread running {{(pid=75949) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 08:08:06 devstack cinder-volume[75949]: DEBUG cinder.db.api [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Building query based on filter {{(pid=75949) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 03 08:08:06 devstack cinder-volume[75949]: DEBUG cinder.image.image_utils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75949) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 08:08:06 devstack cinder-volume[75949]: INFO cinder.keymgr.migration [None req-48685327-38e0-4a5a-8036-a49bf3b46a71 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 08:08:06 devstack cinder-volume[75949]: DEBUG cinder.volume.drivers.lvm [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Updating volume stats {{(pid=75949) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 08:08:06 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:06 devstack sudo[76776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 08:08:06 devstack sudo[76776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:08:06 devstack sudo[76776]: pam_unix(sudo:session): session closed for user root Nov 03 08:08:06 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:06 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:06 devstack sudo[76779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 08:08:06 devstack sudo[76779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:08:06 devstack sudo[76779]: pam_unix(sudo:session): session closed for user root Nov 03 08:08:06 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:06 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:06 devstack sudo[76784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 08:08:06 devstack sudo[76784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:08:07 devstack sudo[76784]: pam_unix(sudo:session): session closed for user root Nov 03 08:08:07 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:07 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:07 devstack sudo[76788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 08:08:07 devstack sudo[76788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:08:07 devstack sudo[76788]: pam_unix(sudo:session): session closed for user root Nov 03 08:08:07 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:07 devstack cinder-volume[75949]: DEBUG cinder.manager [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Notifying Schedulers of capabilities ... {{(pid=75949) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:08:07 devstack cinder-volume[75949]: INFO cinder.volume.manager [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Driver initialization completed successfully. Nov 03 08:08:07 devstack cinder-volume[75949]: INFO cinder.manager [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Initiating service 2 cleanup Nov 03 08:08:07 devstack cinder-volume[75949]: INFO cinder.manager [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Service 2 cleanup completed. Nov 03 08:08:07 devstack cinder-volume[75949]: DEBUG cinder.service [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Creating RPC server for service cinder-volume {{(pid=75949) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 08:08:07 devstack cinder-volume[75949]: DEBUG cinder.service [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75949) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 08:08:07 devstack cinder-volume[75949]: INFO cinder.volume.manager [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 03 08:08:07 devstack cinder-volume[75949]: DEBUG cinder.volume.drivers.lvm [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Updating volume stats {{(pid=75949) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 08:08:07 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:07 devstack sudo[76791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 08:08:07 devstack sudo[76791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:08:07 devstack sudo[76791]: pam_unix(sudo:session): session closed for user root Nov 03 08:08:07 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:07 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:07 devstack sudo[76797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 08:08:07 devstack sudo[76797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:08:08 devstack sudo[76797]: pam_unix(sudo:session): session closed for user root Nov 03 08:08:08 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:08 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:08 devstack sudo[76802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 08:08:08 devstack sudo[76802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:08:08 devstack sudo[76802]: pam_unix(sudo:session): session closed for user root Nov 03 08:08:08 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:08 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:08:08 devstack sudo[76805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 08:08:08 devstack sudo[76805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:08:08 devstack sudo[76805]: pam_unix(sudo:session): session closed for user root Nov 03 08:08:08 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:08:08 devstack cinder-volume[75949]: INFO cinder.volume.manager [None req-e7f400bc-0a45-4b67-9b27-b6c226cb1638 None None] Driver post RPC initialization completed successfully. Nov 03 08:08:11 devstack cinder-volume[75792]: DEBUG dbcounter [-] [75792] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75792) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:08:18 devstack cinder-volume[75949]: DEBUG dbcounter [-] [75949] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75949) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:08:18 devstack cinder-volume[75949]: DEBUG dbcounter [-] [75949] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75949) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:08:50 devstack cinder-volume[75949]: DEBUG oslo_service.periodic_task [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] Running periodic task VolumeManager._thread_info {{(pid=75949) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:08:50 devstack cinder-volume[75949]: DEBUG cinder.volume.manager [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] thread count: 6 {{(pid=75949) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 08:08:50 devstack cinder-volume[75949]: DEBUG cinder.volume.manager [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] thread info: [<_MainThread(MainThread, started 138880284889216)>, , , , , ] {{(pid=75949) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 08:09:50 devstack cinder-volume[75949]: DEBUG oslo_service.periodic_task [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75949) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:09:50 devstack cinder-volume[75949]: DEBUG cinder.volume.drivers.lvm [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] Updating volume stats {{(pid=75949) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 08:09:50 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:09:50 devstack sudo[81877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 08:09:50 devstack sudo[81877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:09:51 devstack sudo[81877]: pam_unix(sudo:session): session closed for user root Nov 03 08:09:51 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:09:51 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:09:51 devstack sudo[81880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 08:09:51 devstack sudo[81880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:09:51 devstack sudo[81880]: pam_unix(sudo:session): session closed for user root Nov 03 08:09:51 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:09:51 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:09:51 devstack sudo[81883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 08:09:51 devstack sudo[81883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:09:51 devstack sudo[81883]: pam_unix(sudo:session): session closed for user root Nov 03 08:09:51 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:09:51 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:09:51 devstack sudo[81886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 08:09:51 devstack sudo[81886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:09:51 devstack sudo[81886]: pam_unix(sudo:session): session closed for user root Nov 03 08:09:51 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:09:51 devstack cinder-volume[75949]: DEBUG cinder.manager [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] Notifying Schedulers of capabilities ... {{(pid=75949) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:09:51 devstack cinder-volume[75949]: DEBUG oslo_service.periodic_task [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] Running periodic task VolumeManager._thread_info {{(pid=75949) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:09:51 devstack cinder-volume[75949]: DEBUG cinder.volume.manager [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] thread count: 6 {{(pid=75949) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 08:09:51 devstack cinder-volume[75949]: DEBUG cinder.volume.manager [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] thread info: [<_MainThread(MainThread, started 138880284889216)>, , , , , ] {{(pid=75949) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 08:10:18 devstack cinder-volume[75949]: DEBUG dbcounter [-] [75949] Writing DB stats cinder:SELECT=1 {{(pid=75949) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:10:18 devstack cinder-volume[75949]: DEBUG dbcounter [-] [75949] Writing DB stats cinder:UPDATE=1 {{(pid=75949) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:10:50 devstack cinder-volume[75949]: DEBUG oslo_service.periodic_task [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75949) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:10:50 devstack cinder-volume[75949]: DEBUG cinder.volume.drivers.lvm [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] Updating volume stats {{(pid=75949) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 08:10:50 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:10:50 devstack sudo[83748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 08:10:50 devstack sudo[83748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:10:51 devstack sudo[83748]: pam_unix(sudo:session): session closed for user root Nov 03 08:10:51 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:10:51 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:10:51 devstack sudo[83760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 08:10:51 devstack sudo[83760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:10:51 devstack sudo[83760]: pam_unix(sudo:session): session closed for user root Nov 03 08:10:51 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:10:51 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:10:51 devstack sudo[83763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 08:10:51 devstack sudo[83763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:10:51 devstack sudo[83763]: pam_unix(sudo:session): session closed for user root Nov 03 08:10:51 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:10:51 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:10:51 devstack sudo[83786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 08:10:51 devstack sudo[83786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:10:51 devstack sudo[83786]: pam_unix(sudo:session): session closed for user root Nov 03 08:10:51 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:10:51 devstack cinder-volume[75949]: DEBUG cinder.manager [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] Notifying Schedulers of capabilities ... {{(pid=75949) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:10:51 devstack cinder-volume[75949]: DEBUG oslo_service.periodic_task [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] Running periodic task VolumeManager._thread_info {{(pid=75949) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:10:51 devstack cinder-volume[75949]: DEBUG cinder.volume.manager [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] thread count: 6 {{(pid=75949) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 08:10:51 devstack cinder-volume[75949]: DEBUG cinder.volume.manager [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] thread info: [<_MainThread(MainThread, started 138880284889216)>, , , , , ] {{(pid=75949) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 08:11:50 devstack cinder-volume[75949]: DEBUG oslo_service.periodic_task [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75949) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:11:50 devstack cinder-volume[75949]: DEBUG cinder.volume.drivers.lvm [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] Updating volume stats {{(pid=75949) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 08:11:50 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:11:50 devstack sudo[85165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 08:11:50 devstack sudo[85165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:11:51 devstack sudo[85165]: pam_unix(sudo:session): session closed for user root Nov 03 08:11:51 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:11:51 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:11:51 devstack sudo[85168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 08:11:51 devstack sudo[85168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:11:51 devstack sudo[85168]: pam_unix(sudo:session): session closed for user root Nov 03 08:11:51 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:11:51 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:11:51 devstack sudo[85174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 08:11:51 devstack sudo[85174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:11:51 devstack sudo[85174]: pam_unix(sudo:session): session closed for user root Nov 03 08:11:51 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.243s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:11:51 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:11:51 devstack sudo[85177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 08:11:51 devstack sudo[85177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:11:51 devstack sudo[85177]: pam_unix(sudo:session): session closed for user root Nov 03 08:11:51 devstack cinder-volume[75949]: DEBUG oslo_concurrency.processutils [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75949) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:11:51 devstack cinder-volume[75949]: DEBUG cinder.manager [None req-18d6a410-ab6b-4ed7-9c17-14b2d0575a60 None None] Notifying Schedulers of capabilities ... {{(pid=75949) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:12:18 devstack cinder-volume[75949]: DEBUG dbcounter [-] [75949] Writing DB stats cinder:SELECT=1 {{(pid=75949) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:12:18 devstack cinder-volume[75949]: DEBUG dbcounter [-] [75949] Writing DB stats cinder:UPDATE=1 {{(pid=75949) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:12:26 devstack cinder-volume[75792]: INFO oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Caught SIGTERM, stopping children Nov 03 08:12:26 devstack cinder-volume[75792]: DEBUG oslo_concurrency.lockutils [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Acquiring lock "singleton_lock" {{(pid=75792) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 08:12:26 devstack cinder-volume[75792]: DEBUG oslo_concurrency.lockutils [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Acquired lock "singleton_lock" {{(pid=75792) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 08:12:26 devstack cinder-volume[75792]: DEBUG oslo_concurrency.lockutils [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Releasing lock "singleton_lock" {{(pid=75792) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 08:12:26 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Stop services. {{(pid=75792) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 03 08:12:26 devstack cinder-volume[75792]: DEBUG oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Killing children. {{(pid=75792) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 03 08:12:26 devstack cinder-volume[75792]: INFO oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Waiting on 1 children to exit Nov 03 08:12:27 devstack cinder-volume[75949]: DEBUG oslo_concurrency.lockutils [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Acquiring lock "singleton_lock" {{(pid=75949) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 08:12:27 devstack cinder-volume[75949]: DEBUG oslo_concurrency.lockutils [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Acquired lock "singleton_lock" {{(pid=75949) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 08:12:27 devstack cinder-volume[75949]: DEBUG oslo_concurrency.lockutils [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Releasing lock "singleton_lock" {{(pid=75949) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 08:12:27 devstack cinder-volume[75949]: WARNING amqp [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 08:12:27 devstack cinder-volume[75949]: WARNING amqp [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 08:12:27 devstack cinder-volume[75792]: INFO oslo_service.backend._eventlet.service [None req-d2fd4064-09d1-4a5b-ae2c-4624683719f9 None None] Child 75949 exited with status 0 Nov 03 08:12:28 devstack cinder-volume[85974]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 08:12:28 devstack cinder-volume[85974]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 08:12:28 devstack cinder-volume[85974]: we strongly recommend against using it for new projects. Nov 03 08:12:28 devstack cinder-volume[85974]: If you are already using Eventlet, we recommend migrating to a different Nov 03 08:12:28 devstack cinder-volume[85974]: framework. For more detail see Nov 03 08:12:28 devstack cinder-volume[85974]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 08:12:28 devstack cinder-volume[85974]: import eventlet # noqa Nov 03 08:12:29 devstack cinder-volume[85974]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85974) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 08:12:29 devstack cinder-volume[85974]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85974) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 08:12:29 devstack cinder-volume[85974]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85974) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 08:12:30 devstack cinder-volume[85974]: INFO dbcounter [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] Registered counter for database cinder Nov 03 08:12:30 devstack cinder-volume[85974]: DEBUG oslo_db.sqlalchemy.engines [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85974) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 08:12:30 devstack cinder-volume[85974]: DEBUG dbcounter [-] [85974] Writer thread running {{(pid=85974) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 08:12:30 devstack cinder-volume[85974]: INFO cinder.rpc [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 08:12:30 devstack cinder-volume[85974]: INFO cinder.rpc [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_db.sqlalchemy.engines [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85974) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 08:12:31 devstack cinder-volume[85974]: INFO cinder.volume.manager [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] Determined volume DB was empty at startup. Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG cinder.volume.manager [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85974) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 08:12:31 devstack cinder-volume[85974]: INFO cinder.volume.manager [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 03 08:12:31 devstack cinder-volume[85974]: WARNING stevedore.named [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 08:12:31 devstack cinder-volume[85974]: WARNING castellan.key_manager [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 08:12:31 devstack cinder-volume[85974]: WARNING cinder.keymgr.conf_key_mgr [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 08:12:31 devstack cinder-volume[85974]: INFO cinder.volume.manager [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_db.sqlalchemy.engines [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85974) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 08:12:31 devstack cinder-volume[85974]: INFO oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] Starting 1 workers Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] Started child 86190 {{(pid=85974) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] Full set of CONF: {{(pid=85974) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] ******************************************************************************** {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] Configuration options gathered from: {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] ================================================================================ {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] allow_availability_zone_fallback = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] allow_compression_on_image_upload = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] allowed_direct_url_schemes = [] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] api_rate_limit = True {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] auth_strategy = keystone {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_availability_zone = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_host = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_name = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[86190]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_stats_polling_interval = 60 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backup_api_class = cinder.backup.api.API {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backup_name_template = backup-%s {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backup_use_same_host = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backup_use_temp_snapshot = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] chap_password = **** {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] chap_username = {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cinder_internal_tenant_project_id = 824b57911041451f9c5eb73c2e42cb9f {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cinder_internal_tenant_user_id = e38a97466db24a5a932294c6d1dbd4ff {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cluster = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] compression_format = gzip {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] compute_api_class = cinder.compute.nova.API {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] config_dir = [] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] config_source = [] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] control_exchange = openstack {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] debug = True {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] default_availability_zone = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] default_group_type = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] default_volume_type = QuobyteHD {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] disk_geometry = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] driver_client_cert = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] driver_client_cert_key = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] driver_data_namespace = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] driver_ssl_cert_path = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] driver_ssl_cert_verify = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] driver_use_ssl = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] enable_new_services = True {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] enable_unsupported_driver = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] enabled_backends = ['QuobyteHD'] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] enforce_multipath_for_image_xfer = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] filter_function = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] glance_api_insecure = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] glance_api_servers = ['http://192.168.122.104/image'] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] glance_api_ssl_compression = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] glance_ca_certificates_file = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] glance_catalog_info = image:glance:publicURL {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] glance_certfile = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] glance_keyfile = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] glance_num_retries = 3 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] glance_request_timeout = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] goodness_function = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] graceful_shutdown_timeout = 5 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] group_api_class = cinder.group.api.API {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] host = devstack {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] image_compress_on_upload = True {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] image_conversion_address_space_limit = 1 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] image_conversion_cpu_limit = 60 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] image_conversion_disable = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] image_introspection_address_space_limit = 1 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] image_introspection_cpu_limit = 60 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] image_upload_use_cinder_backend = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] image_upload_use_internal_tenant = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] image_volume_cache_enabled = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] image_volume_cache_max_count = 0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] image_volume_cache_max_size_gb = 0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] init_host_max_objects_retrieval = 0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] instance_format = [instance: %(uuid)s] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] iscsi_target_flags = {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] iscsi_write_cache = on {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] iser_helper = tgtadm {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] iser_ip_address = 192.168.122.104 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] iser_port = 3260 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] log_color = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] log_config_append = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] log_dir = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] log_file = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] log_options = True {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] log_rotate_interval = 1 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] log_rotate_interval_type = days {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] log_rotation_type = none {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] max_age = 0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[86190]: INFO cinder.volume.manager [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 03 08:12:31 devstack cinder-volume[86190]: DEBUG cinder.volume.drivers.remotefs [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86190) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] max_logfile_count = 30 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] max_logfile_size_mb = 200 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] max_over_subscription_ratio = 20.0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] message_reap_interval = 86400 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] message_ttl = 2592000 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] migration_create_volume_timeout_secs = 300 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] monkey_patch = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] monkey_patch_modules = [] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] my_ip = 192.168.122.104 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] no_snapshot_gb_quota = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] num_iser_scan_tries = 3 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] num_shell_tries = 3 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] num_volume_device_scan_tries = 3 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] nvmeof_conn_info_version = 1 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] nvmet_ns_id = 10 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] nvmet_port_id = 1 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] osapi_max_limit = 1000 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] osapi_volume_ext_list = [] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] osapi_volume_listen_port = 8776 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] osapi_volume_use_ssl = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] osapi_volume_workers = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] per_volume_size_limit = -1 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] periodic_fuzzy_delay = 60 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] periodic_interval = 60 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] public_endpoint = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] publish_errors = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] quota_backup_gigabytes = 1000 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] quota_backups = 10 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] quota_gigabytes = 1000 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] quota_groups = 10 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] quota_snapshots = 10 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] quota_volumes = 10 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] rate_limit_burst = 0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] rate_limit_except_level = CRITICAL {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] rate_limit_interval = 0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] reinit_driver_count = 3 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] replication_device = **** {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] report_discard_supported = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] report_interval = 120 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] reservation_clean_interval = 86400 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] reservation_expire = 86400 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] reserved_image_namespaces = [] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] reserved_percentage = 0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] rpc_response_timeout = 120 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] run_external_periodic_tasks = True {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] scst_target_driver = iscsi {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] scst_target_iqn_name = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] service_down_time = 720 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] shell_completion = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] snapshot_name_template = snapshot-%s {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] split_loggers = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] state_path = /opt/stack/data/cinder {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] storage_availability_zone = nova {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] storage_protocol = iSCSI {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] syslog_log_facility = LOG_USER {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] target_helper = lioadm {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] target_ip_address = 192.168.122.104 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] target_port = 3260 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] target_protocol = iscsi {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] target_secondary_ip_addresses = [] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] trace_flags = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] transport_url = **** {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] until_refresh = 0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] use_chap_auth = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] use_default_quota_class = True {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] use_journal = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] use_json = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] use_multipath_for_image_xfer = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] use_stderr = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] use_syslog = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] verify_glance_signatures = enabled {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] volume_api_class = cinder.volume.api.API {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] volume_backend_name = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] volume_clear = zero {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] volume_clear_ionice = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] volume_clear_size = 0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] volume_copy_bps_limit = 0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] volume_dd_blocksize = 1M {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] volume_name_template = volume-%s {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] volume_service_inithost_offload = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] volume_usage_audit_period = month {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] zoning_mode = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_concurrency.disable_process_locking = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.auth_section = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.auth_type = password {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.auth_version = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.cache = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.certfile = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.include_service_catalog = True {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.insecure = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.interface = public {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.keyfile = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.memcache_password = **** {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.memcache_username = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.region_name = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.service_type = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.104/identity {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.backend = dogpile.cache.null {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.backend_argument = **** {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.backend_expiration_time = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.config_prefix = cache.oslo {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.debug_cache_backend = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.enable_retry_client = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.enable_socket_keepalive = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.enabled = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.expiration_time = 600 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.hashclient_retry_attempts = 2 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.memcache_dead_retry = 300 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.memcache_pool_maxsize = 10 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.memcache_sasl_enabled = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.password = **** {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.proxies = [] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.redis_db = 0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.redis_server = localhost:6379 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.retry_attempts = 2 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.retry_delay = 0.0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.socket_keepalive_count = 1 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.socket_keepalive_idle = 1 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.socket_keepalive_interval = 1 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.socket_timeout = 1.0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.tls_allowed_ciphers = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.tls_cafile = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.tls_certfile = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.tls_enabled = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.tls_keyfile = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cache.username = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] coordination.backend_url = **** {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] database.asyncio_connection = **** {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] database.asyncio_slave_connection = **** {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] database.backend = sqlalchemy {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] database.connection = **** {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] database.connection_debug = 0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] database.connection_parameters = {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] database.connection_recycle_time = 3600 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] database.connection_trace = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] database.db_inc_retry_interval = True {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] database.db_max_retries = 20 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] database.db_max_retry_interval = 10 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] database.db_retry_interval = 1 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] database.max_overflow = 50 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] database.max_pool_size = 5 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] database.max_retries = 10 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] database.mysql_wsrep_sync_wait = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] database.pool_timeout = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] database.retry_interval = 10 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] database.slave_connection = **** {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] database.sqlite_synchronous = True {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] database.synchronous_reader = True {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] database.use_db_reconnect = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_tracing.insecure = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] profiler.connection_string = messaging:// {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] profiler.enabled = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] profiler.es_doc_type = notification {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] profiler.es_scroll_size = 10000 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] profiler.es_scroll_time = 2m {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] profiler.filter_error_trace = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] profiler.hmac_keys = **** {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] profiler.sentinel_service_name = mymaster {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] profiler.socket_timeout = 0.1 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] profiler.trace_requests = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] profiler.trace_sqlalchemy = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] profiler_jaeger.process_tags = {} {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] profiler_jaeger.service_name_prefix = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] profiler_otlp.service_name_prefix = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_policy.enforce_new_defaults = True {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_policy.policy_default_rule = default {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_policy.policy_file = policy.yaml {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] privsep_osbrick.group = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] privsep_osbrick.helper_command = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] privsep_osbrick.user = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cinder_sys_admin.group = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cinder_sys_admin.helper_command = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] cinder_sys_admin.user = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[86190]: DEBUG cinder.volume.drivers.quobyte [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86190) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] service_user.auth_section = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] service_user.auth_type = password {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] service_user.cafile = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] service_user.certfile = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] service_user.collect_timing = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] service_user.insecure = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] service_user.keyfile = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] service_user.send_service_user_token = True {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] service_user.split_loggers = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] service_user.timeout = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] service_user.tls_ciphers = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] service_user.tls_min_version = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] glance.auth_section = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] glance.auth_type = password {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[86190]: WARNING cinder.volume.drivers.quobyte [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[86190]: WARNING cinder.volume.drivers.quobyte [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] glance.certfile = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] glance.collect_timing = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] glance.insecure = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] glance.keyfile = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] glance.region_name = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] glance.split_loggers = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] glance.timeout = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] glance.tls_ciphers = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] glance.tls_min_version = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.backend_availability_zone = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[86190]: DEBUG oslo_concurrency.processutils [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Running cmd (subprocess): mount.quobyte {{(pid=86190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.chap_password = **** {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.chap_username = {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.disk_geometry = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.driver_client_cert = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.driver_client_cert_key = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.driver_data_namespace = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.driver_use_ssl = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.extra_capabilities = {} {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.filter_function = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.goodness_function = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.iscsi_target_flags = {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.iscsi_write_cache = on {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.iser_helper = tgtadm {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.iser_ip_address = 192.168.122.104 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.iser_port = 3260 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.nas_host = {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.nas_login = admin {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.nas_mount_options = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.nas_password = **** {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.nas_private_key = {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.nas_share_path = {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.num_shell_tries = 3 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.quobyte_volume_url = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.replication_device = **** {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.report_discard_supported = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.reserved_percentage = 0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.target_helper = tgtadm {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.target_ip_address = 192.168.122.104 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.target_port = 3260 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.target_protocol = iscsi {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.trace_flags = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.unique_fqdn_network = True {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.use_chap_auth = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.volume_backend_name = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.volume_clear = zero {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.volume_clear_ionice = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.volume_clear_size = 0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_reports.file_event_handler = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_reports.log_dir = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.backend_availability_zone = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.backend_host = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.chap_password = **** {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.chap_username = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.chiscsi_conf = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.disk_geometry = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.driver_client_cert = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.driver_data_namespace = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.driver_use_ssl = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.extra_capabilities = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.filter_function = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.goodness_function = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.iser_helper = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.iser_ip_address = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.iser_port = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.iser_target_prefix = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.nas_host = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.nas_login = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.nas_mount_options = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.nas_password = **** {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.nas_private_key = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.nas_share_path = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.nas_ssh_port = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.num_shell_tries = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.nvmet_port_id = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.replication_device = **** {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.report_discard_supported = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.reserved_percentage = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.scst_target_driver = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.storage_protocol = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.target_helper = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.target_ip_address = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.target_port = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.target_prefix = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.target_protocol = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.trace_flags = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.use_chap_auth = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.volume_clear = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.volume_clear_size = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] QuobyteHD.volumes_dir = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.ssl = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_notifications.driver = [] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_notifications.retry = -1 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] key_manager.fixed_key = **** {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican.barbican_api_version = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican.barbican_endpoint = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican.barbican_endpoint_type = public {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican.barbican_region_name = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican.cafile = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican.certfile = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican.collect_timing = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican.insecure = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican.keyfile = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican.number_of_retries = 60 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican.retry_delay = 1 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican.send_service_user_token = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican.split_loggers = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican.timeout = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican.tls_ciphers = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican.tls_min_version = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican.verify_ssl = True {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican.verify_ssl_path = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican_service_user.auth_section = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican_service_user.auth_type = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican_service_user.cafile = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican_service_user.certfile = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican_service_user.collect_timing = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican_service_user.insecure = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican_service_user.keyfile = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican_service_user.split_loggers = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican_service_user.timeout = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican_service_user.tls_ciphers = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] barbican_service_user.tls_min_version = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] vault.approle_role_id = **** {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] vault.approle_secret_id = **** {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] vault.auth_method = approle {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] vault.auth_path = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] vault.kv_mountpoint = secret {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] vault.kv_path = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] vault.kv_version = 2 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] vault.namespace = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] vault.root_token_id = **** {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] vault.ssl_ca_crt_file = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] vault.timeout = 60.0 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] vault.token_file = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] vault.token_role = None {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] vault.use_ssl = False {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:31 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] ******************************************************************************** {{(pid=85974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 08:12:31 devstack cinder-volume[86190]: DEBUG oslo_concurrency.processutils [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] CMD "mount.quobyte" returned: 1 in 0.153s {{(pid=86190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:12:31 devstack cinder-volume[86190]: DEBUG oslo_concurrency.lockutils [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86190) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:12:31 devstack cinder-volume[86190]: DEBUG oslo_concurrency.lockutils [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86190) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:12:31 devstack cinder-volume[86190]: DEBUG cinder.volume.drivers.quobyte [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86190) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:12:31 devstack cinder-volume[86190]: INFO cinder.volume.drivers.quobyte [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f ... Nov 03 08:12:31 devstack cinder-volume[86190]: DEBUG oslo_concurrency.processutils [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba -c /etc/quobyte/client-cinder.cfg {{(pid=86190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:12:31 devstack sudo[86196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba -c /etc/quobyte/client-cinder.cfg Nov 03 08:12:31 devstack sudo[86196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:12:32 devstack sudo[86196]: pam_unix(sudo:session): session closed for user root Nov 03 08:12:32 devstack cinder-volume[86190]: DEBUG oslo_concurrency.processutils [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.405s {{(pid=86190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:12:32 devstack cinder-volume[86190]: INFO cinder.volume.drivers.quobyte [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f succeeded Nov 03 08:12:32 devstack cinder-volume[86190]: DEBUG cinder.volume.drivers.quobyte [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86190) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:12:32 devstack cinder-volume[86190]: DEBUG oslo_concurrency.lockutils [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.419s {{(pid=86190) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:12:32 devstack cinder-volume[86190]: DEBUG oslo_concurrency.processutils [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:12:32 devstack sudo[86298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:12:32 devstack sudo[86298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:12:32 devstack sudo[86298]: pam_unix(sudo:session): session closed for user root Nov 03 08:12:32 devstack cinder-volume[86190]: DEBUG oslo_concurrency.processutils [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.241s {{(pid=86190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:12:32 devstack cinder-volume[86190]: INFO cinder.volume.driver [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Driver hasn't implemented _init_vendor_properties() Nov 03 08:12:32 devstack cinder-volume[86190]: DEBUG cinder.volume.driver [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.721305847168, 'free_capacity_gb': 1773.721305847168, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86190) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 08:12:32 devstack cinder-volume[86190]: DEBUG oslo_db.sqlalchemy.engines [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86190) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 08:12:32 devstack cinder-volume[86190]: DEBUG dbcounter [-] [86190] Writer thread running {{(pid=86190) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 08:12:32 devstack cinder-volume[86190]: DEBUG cinder.db.api [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Building query based on filter {{(pid=86190) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 03 08:12:32 devstack cinder-volume[86190]: DEBUG cinder.image.image_utils [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86190) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 08:12:32 devstack cinder-volume[86190]: INFO cinder.keymgr.migration [None req-4589bec2-8a3a-491b-b39f-63f25cfe60eb None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 08:12:32 devstack cinder-volume[86190]: DEBUG oslo_concurrency.lockutils [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86190) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:12:32 devstack cinder-volume[86190]: DEBUG oslo_concurrency.lockutils [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86190) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:12:32 devstack cinder-volume[86190]: DEBUG cinder.volume.drivers.quobyte [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86190) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:12:32 devstack cinder-volume[86190]: DEBUG cinder.volume.drivers.quobyte [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86190) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:12:32 devstack cinder-volume[86190]: DEBUG oslo_concurrency.lockutils [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86190) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:12:32 devstack cinder-volume[86190]: DEBUG oslo_concurrency.processutils [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:12:32 devstack sudo[86301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:12:32 devstack sudo[86301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:12:32 devstack sudo[86301]: pam_unix(sudo:session): session closed for user root Nov 03 08:12:32 devstack cinder-volume[86190]: DEBUG oslo_concurrency.processutils [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.219s {{(pid=86190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:12:32 devstack cinder-volume[86190]: DEBUG cinder.manager [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Notifying Schedulers of capabilities ... {{(pid=86190) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:12:32 devstack cinder-volume[86190]: INFO cinder.volume.manager [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Driver initialization completed successfully. Nov 03 08:12:32 devstack cinder-volume[86190]: INFO cinder.manager [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Initiating service 3 cleanup Nov 03 08:12:32 devstack cinder-volume[86190]: INFO cinder.manager [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Service 3 cleanup completed. Nov 03 08:12:32 devstack cinder-volume[86190]: DEBUG cinder.service [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Creating RPC server for service cinder-volume {{(pid=86190) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 08:12:32 devstack cinder-volume[86190]: DEBUG cinder.service [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86190) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 08:12:32 devstack cinder-volume[86190]: INFO cinder.volume.manager [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 03 08:12:32 devstack cinder-volume[86190]: DEBUG oslo_concurrency.lockutils [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86190) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:12:32 devstack cinder-volume[86190]: DEBUG oslo_concurrency.lockutils [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86190) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:12:32 devstack cinder-volume[86190]: DEBUG cinder.volume.drivers.quobyte [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86190) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:12:32 devstack cinder-volume[86190]: DEBUG cinder.volume.drivers.quobyte [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86190) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:12:32 devstack cinder-volume[86190]: DEBUG oslo_concurrency.lockutils [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86190) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:12:32 devstack cinder-volume[86190]: DEBUG oslo_concurrency.processutils [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:12:32 devstack sudo[86304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:12:32 devstack sudo[86304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:12:33 devstack sudo[86304]: pam_unix(sudo:session): session closed for user root Nov 03 08:12:33 devstack cinder-volume[86190]: DEBUG oslo_concurrency.processutils [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.257s {{(pid=86190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:12:33 devstack cinder-volume[86190]: INFO cinder.volume.manager [None req-4b18dd7a-e9ad-4dbd-b60a-4abf9d6a4194 None None] Driver post RPC initialization completed successfully. Nov 03 08:12:37 devstack cinder-volume[86190]: DEBUG oslo_concurrency.lockutils [None req-338d104e-f579-487d-82a5-8f0ec0fc79fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86190) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:12:37 devstack cinder-volume[86190]: DEBUG oslo_concurrency.lockutils [None req-338d104e-f579-487d-82a5-8f0ec0fc79fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86190) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:12:37 devstack cinder-volume[86190]: DEBUG cinder.volume.drivers.quobyte [None req-338d104e-f579-487d-82a5-8f0ec0fc79fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86190) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:12:37 devstack cinder-volume[86190]: DEBUG cinder.volume.drivers.quobyte [None req-338d104e-f579-487d-82a5-8f0ec0fc79fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86190) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:12:37 devstack cinder-volume[86190]: DEBUG oslo_concurrency.lockutils [None req-338d104e-f579-487d-82a5-8f0ec0fc79fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86190) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:12:37 devstack cinder-volume[86190]: DEBUG oslo_concurrency.processutils [None req-338d104e-f579-487d-82a5-8f0ec0fc79fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:12:37 devstack sudo[86436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:12:37 devstack sudo[86436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:12:37 devstack sudo[86436]: pam_unix(sudo:session): session closed for user root Nov 03 08:12:37 devstack cinder-volume[86190]: DEBUG oslo_concurrency.processutils [None req-338d104e-f579-487d-82a5-8f0ec0fc79fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.254s {{(pid=86190) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:12:37 devstack cinder-volume[86190]: DEBUG cinder.manager [None req-338d104e-f579-487d-82a5-8f0ec0fc79fb None None] Notifying Schedulers of capabilities ... {{(pid=86190) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:12:38 devstack cinder-volume[86190]: DEBUG oslo_service.periodic_task [None req-07cfb06d-bd2a-4522-99c4-e611472a71c1 None None] Running periodic task VolumeManager._thread_info {{(pid=86190) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:12:38 devstack cinder-volume[86190]: DEBUG cinder.volume.manager [None req-07cfb06d-bd2a-4522-99c4-e611472a71c1 None None] thread count: 6 {{(pid=86190) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 08:12:38 devstack cinder-volume[86190]: DEBUG cinder.volume.manager [None req-07cfb06d-bd2a-4522-99c4-e611472a71c1 None None] thread info: [<_MainThread(MainThread, started 129332429308032)>, , , , , ] {{(pid=86190) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 08:12:38 devstack cinder-volume[85974]: INFO oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] Caught SIGTERM, stopping children Nov 03 08:12:38 devstack cinder-volume[85974]: DEBUG oslo_concurrency.lockutils [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] Acquiring lock "singleton_lock" {{(pid=85974) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 08:12:38 devstack cinder-volume[85974]: DEBUG oslo_concurrency.lockutils [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] Acquired lock "singleton_lock" {{(pid=85974) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 08:12:38 devstack cinder-volume[85974]: DEBUG oslo_concurrency.lockutils [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] Releasing lock "singleton_lock" {{(pid=85974) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 08:12:38 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] Stop services. {{(pid=85974) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 03 08:12:38 devstack cinder-volume[85974]: DEBUG oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] Killing children. {{(pid=85974) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 03 08:12:38 devstack cinder-volume[85974]: INFO oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] Waiting on 1 children to exit Nov 03 08:12:41 devstack cinder-volume[86190]: DEBUG oslo_concurrency.lockutils [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] Acquiring lock "singleton_lock" {{(pid=86190) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 08:12:41 devstack cinder-volume[86190]: DEBUG oslo_concurrency.lockutils [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] Acquired lock "singleton_lock" {{(pid=86190) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 08:12:41 devstack cinder-volume[86190]: DEBUG oslo_concurrency.lockutils [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] Releasing lock "singleton_lock" {{(pid=86190) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 08:12:41 devstack cinder-volume[86190]: WARNING amqp [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 08:12:41 devstack cinder-volume[86190]: WARNING amqp [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 08:12:41 devstack cinder-volume[85974]: INFO oslo_service.backend._eventlet.service [None req-f9b34c72-cd79-4c17-bd8d-525fb9e6a151 None None] Child 86190 exited with status 0 Nov 03 08:12:41 devstack cinder-volume[86505]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 08:12:41 devstack cinder-volume[86505]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 08:12:41 devstack cinder-volume[86505]: we strongly recommend against using it for new projects. Nov 03 08:12:41 devstack cinder-volume[86505]: If you are already using Eventlet, we recommend migrating to a different Nov 03 08:12:41 devstack cinder-volume[86505]: framework. For more detail see Nov 03 08:12:41 devstack cinder-volume[86505]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 08:12:41 devstack cinder-volume[86505]: import eventlet # noqa Nov 03 08:12:44 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86505) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 08:12:44 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86505) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 08:12:44 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86505) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 08:12:45 devstack cinder-volume[86505]: INFO dbcounter [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] Registered counter for database cinder Nov 03 08:12:45 devstack cinder-volume[86505]: DEBUG oslo_db.sqlalchemy.engines [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86505) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG dbcounter [-] [86505] Writer thread running {{(pid=86505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 08:12:46 devstack cinder-volume[86505]: INFO cinder.rpc [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 08:12:46 devstack cinder-volume[86505]: INFO cinder.rpc [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_db.sqlalchemy.engines [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86505) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 08:12:46 devstack cinder-volume[86505]: INFO cinder.volume.manager [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] Determined volume DB was empty at startup. Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG cinder.volume.manager [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86505) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 08:12:46 devstack cinder-volume[86505]: WARNING stevedore.named [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 08:12:46 devstack cinder-volume[86505]: WARNING castellan.key_manager [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 08:12:46 devstack cinder-volume[86505]: WARNING cinder.keymgr.conf_key_mgr [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 08:12:46 devstack cinder-volume[86505]: INFO cinder.volume.manager [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_db.sqlalchemy.engines [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86505) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 08:12:46 devstack cinder-volume[86505]: INFO oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] Starting 1 workers Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] Started child 86801 {{(pid=86505) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] Full set of CONF: {{(pid=86505) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] ******************************************************************************** {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] Configuration options gathered from: {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] ================================================================================ {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 08:12:46 devstack cinder-volume[86801]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] allow_availability_zone_fallback = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] allow_compression_on_image_upload = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] allowed_direct_url_schemes = [] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] api_rate_limit = True {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] auth_strategy = keystone {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_availability_zone = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_host = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_name = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_stats_polling_interval = 60 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backup_api_class = cinder.backup.api.API {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backup_name_template = backup-%s {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backup_use_same_host = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backup_use_temp_snapshot = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] chap_password = **** {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] chap_username = {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cinder_internal_tenant_project_id = 824b57911041451f9c5eb73c2e42cb9f {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cinder_internal_tenant_user_id = e38a97466db24a5a932294c6d1dbd4ff {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cluster = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] compression_format = gzip {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] compute_api_class = cinder.compute.nova.API {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] config_dir = [] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] config_source = [] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] control_exchange = openstack {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] debug = True {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] default_availability_zone = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] default_group_type = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] default_volume_type = QuobyteHD {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] disk_geometry = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] driver_client_cert = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] driver_client_cert_key = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] driver_data_namespace = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] driver_ssl_cert_path = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] driver_ssl_cert_verify = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] driver_use_ssl = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] enable_new_services = True {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] enable_unsupported_driver = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] enabled_backends = ['QuobyteHD'] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] enforce_multipath_for_image_xfer = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] filter_function = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] glance_api_insecure = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] glance_api_servers = ['http://192.168.122.104/image'] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] glance_api_ssl_compression = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] glance_ca_certificates_file = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] glance_catalog_info = image:glance:publicURL {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] glance_certfile = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] glance_keyfile = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] glance_num_retries = 3 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] glance_request_timeout = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] goodness_function = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] graceful_shutdown_timeout = 5 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] group_api_class = cinder.group.api.API {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] host = devstack {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] image_compress_on_upload = True {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] image_conversion_address_space_limit = 1 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] image_conversion_cpu_limit = 60 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] image_conversion_disable = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] image_introspection_address_space_limit = 1 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] image_introspection_cpu_limit = 60 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] image_upload_use_cinder_backend = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] image_upload_use_internal_tenant = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] image_volume_cache_enabled = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] image_volume_cache_max_count = 0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] image_volume_cache_max_size_gb = 0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] init_host_max_objects_retrieval = 0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] instance_format = [instance: %(uuid)s] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] iscsi_target_flags = {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] iscsi_write_cache = on {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] iser_helper = tgtadm {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] iser_ip_address = 192.168.122.104 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] iser_port = 3260 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] log_color = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] log_config_append = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] log_dir = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] log_file = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] log_options = True {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] log_rotate_interval = 1 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] log_rotate_interval_type = days {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] log_rotation_type = none {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] max_age = 0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Starting volume driver QuobyteDriver (1.2.1) Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] max_logfile_count = 30 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] max_logfile_size_mb = 200 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] max_over_subscription_ratio = 20.0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] message_reap_interval = 86400 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] message_ttl = 2592000 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] migration_create_volume_timeout_secs = 300 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] monkey_patch = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] monkey_patch_modules = [] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] my_ip = 192.168.122.104 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] no_snapshot_gb_quota = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] num_iser_scan_tries = 3 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] num_shell_tries = 3 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] num_volume_device_scan_tries = 3 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86801) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] nvmeof_conn_info_version = 1 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] nvmet_ns_id = 10 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] nvmet_port_id = 1 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] osapi_max_limit = 1000 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] osapi_volume_ext_list = [] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] osapi_volume_listen = 0.0.0.0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] osapi_volume_listen_port = 8776 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] osapi_volume_use_ssl = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] osapi_volume_workers = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] per_volume_size_limit = -1 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] periodic_fuzzy_delay = 60 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] periodic_interval = 60 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] project_id_regex = [0-9a-f\-]+ {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] public_endpoint = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] publish_errors = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] quota_backup_gigabytes = 1000 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] quota_backups = 10 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] quota_gigabytes = 1000 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] quota_groups = 10 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] quota_snapshots = 10 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] quota_volumes = 10 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] rate_limit_burst = 0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] rate_limit_except_level = CRITICAL {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] rate_limit_interval = 0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] reinit_driver_count = 3 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] replication_device = **** {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] report_discard_supported = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] report_interval = 120 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] reservation_clean_interval = 86400 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] reservation_expire = 86400 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] reserved_image_namespaces = [] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] reserved_percentage = 0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] rpc_response_timeout = 120 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] run_external_periodic_tasks = True {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] scst_target_driver = iscsi {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] scst_target_iqn_name = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] service_down_time = 720 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] shell_completion = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] snapshot_name_template = snapshot-%s {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] split_loggers = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] state_path = /opt/stack/data/cinder {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] storage_availability_zone = nova {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] storage_protocol = iSCSI {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] syslog_log_facility = LOG_USER {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] target_helper = lioadm {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] target_ip_address = 192.168.122.104 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] target_port = 3260 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] target_protocol = iscsi {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] target_secondary_ip_addresses = [] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] trace_flags = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] transfer_api_class = cinder.transfer.api.API {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] transport_url = **** {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] until_refresh = 0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] use_chap_auth = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] use_default_quota_class = True {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] use_journal = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] use_json = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] use_multipath_for_image_xfer = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] use_stderr = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] use_syslog = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] verify_glance_signatures = enabled {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] volume_api_class = cinder.volume.api.API {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] volume_backend_name = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] volume_clear = zero {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] volume_clear_ionice = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] volume_clear_size = 0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] volume_copy_bps_limit = 0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] volume_dd_blocksize = 1M {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] volume_name_template = volume-%s {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] volume_service_inithost_offload = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] volume_usage_audit_period = month {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] zoning_mode = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_concurrency.disable_process_locking = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.auth_section = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.auth_type = password {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.auth_version = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.cache = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.certfile = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.delay_auth_decision = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.http_connect_timeout = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.include_service_catalog = True {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.insecure = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.interface = public {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.keyfile = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.memcache_password = **** {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.memcache_username = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.region_name = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.service_token_roles_required = True {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.service_type = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.token_cache_time = 300 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.104/identity {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.backend = dogpile.cache.null {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.backend_argument = **** {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.backend_expiration_time = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.config_prefix = cache.oslo {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86801) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 03 08:12:46 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.quobyte [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.debug_cache_backend = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.quobyte [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.enable_retry_client = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.enable_socket_keepalive = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.enabled = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.expiration_time = 600 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Running cmd (subprocess): mount.quobyte {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.hashclient_retry_attempts = 2 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.memcache_dead_retry = 300 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.memcache_pool_maxsize = 10 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.memcache_sasl_enabled = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.password = **** {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.proxies = [] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.redis_db = 0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.redis_sentinel_service_name = mymaster {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.redis_server = localhost:6379 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.retry_attempts = 2 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.retry_delay = 0.0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.socket_keepalive_count = 1 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.socket_keepalive_idle = 1 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.socket_keepalive_interval = 1 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.socket_timeout = 1.0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.tls_allowed_ciphers = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.tls_cafile = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.tls_certfile = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.tls_enabled = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.tls_keyfile = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cache.username = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] coordination.backend_url = **** {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] database.asyncio_connection = **** {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] database.asyncio_slave_connection = **** {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] database.backend = sqlalchemy {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] database.connection = **** {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] database.connection_debug = 0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] database.connection_parameters = {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] database.connection_recycle_time = 3600 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] database.connection_trace = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] database.db_inc_retry_interval = True {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] database.db_max_retries = 20 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] database.db_max_retry_interval = 10 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] database.db_retry_interval = 1 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] database.max_overflow = 50 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] database.max_pool_size = 5 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] database.max_retries = 10 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] database.mysql_wsrep_sync_wait = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] database.pool_timeout = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] database.retry_interval = 10 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] database.slave_connection = **** {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] database.sqlite_synchronous = True {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] database.synchronous_reader = True {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] database.use_db_reconnect = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_tracing.insecure = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] profiler.connection_string = messaging:// {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] profiler.enabled = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] profiler.es_doc_type = notification {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] profiler.es_scroll_size = 10000 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] profiler.es_scroll_time = 2m {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] profiler.filter_error_trace = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] profiler.hmac_keys = **** {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] profiler.sentinel_service_name = mymaster {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] profiler.socket_timeout = 0.1 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] profiler.trace_requests = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] profiler.trace_sqlalchemy = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] profiler_jaeger.process_tags = {} {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] profiler_jaeger.service_name_prefix = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] profiler_otlp.service_name_prefix = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_policy.enforce_new_defaults = True {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_policy.policy_default_rule = default {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_policy.policy_file = policy.yaml {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_policy.remote_timeout = 60.0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] privsep_osbrick.group = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] privsep_osbrick.helper_command = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] privsep_osbrick.user = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cinder_sys_admin.group = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cinder_sys_admin.helper_command = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] cinder_sys_admin.user = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] service_user.auth_section = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] service_user.auth_type = password {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] service_user.cafile = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] service_user.certfile = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] service_user.collect_timing = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] service_user.insecure = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] service_user.keyfile = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] service_user.send_service_user_token = True {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] service_user.split_loggers = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] service_user.timeout = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] service_user.tls_ciphers = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack quobyte-client[86802]: Reading configuration file: /etc/quobyte/client.cfg Nov 03 08:12:46 devstack quobyte-client[86802]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] service_user.tls_min_version = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] glance.auth_section = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] glance.auth_type = password {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] glance.certfile = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] glance.collect_timing = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] CMD "mount.quobyte" returned: 1 in 0.047s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:12:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] glance.insecure = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] glance.keyfile = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] glance.region_name = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:12:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] glance.split_loggers = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] glance.timeout = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] glance.tls_ciphers = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] glance.tls_min_version = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.backend_availability_zone = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.chap_password = **** {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.chap_username = {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.disk_geometry = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.driver_client_cert = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.driver_client_cert_key = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.driver_data_namespace = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.driver_use_ssl = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.enable_unsupported_driver = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.extra_capabilities = {} {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.filter_function = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.goodness_function = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.iscsi_target_flags = {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.iscsi_write_cache = on {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.iser_helper = tgtadm {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.iser_ip_address = 192.168.122.104 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.iser_port = 3260 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.nas_host = {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.nas_login = admin {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:12:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:12:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.nas_mount_options = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.nas_password = **** {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.nas_private_key = {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.nas_share_path = {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.nas_ssh_port = 22 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.num_shell_tries = 3 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.nvmet_port_id = 1 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.quobyte_client_cfg = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.quobyte_volume_url = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.replication_device = **** {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.report_discard_supported = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.reserved_percentage = 0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.scst_target_driver = iscsi {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.scst_target_iqn_name = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.storage_protocol = iSCSI {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.target_helper = tgtadm {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.target_ip_address = 192.168.122.104 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.target_port = 3260 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.target_protocol = iscsi {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.trace_flags = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.unique_fqdn_network = True {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.use_chap_auth = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.volume_backend_name = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.volume_clear = zero {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.volume_clear_ionice = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.volume_clear_size = 0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_reports.file_event_handler = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_reports.log_dir = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.backend_availability_zone = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.backend_host = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.chap_password = **** {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.chap_username = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.chiscsi_conf = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.disk_geometry = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.driver_client_cert = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.driver_client_cert_key = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.driver_data_namespace = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.driver_use_ssl = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.extra_capabilities = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.filter_function = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.goodness_function = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.iscsi_target_flags = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.iscsi_write_cache = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.iser_helper = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.iser_ip_address = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.iser_port = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.iser_target_prefix = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.nas_host = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.nas_login = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.nas_mount_options = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.nas_password = **** {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.nas_private_key = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.nas_share_path = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.nas_ssh_port = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.num_shell_tries = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack sudo[86810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.nvmet_ns_id = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.nvmet_port_id = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack sudo[86810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.replication_device = **** {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.report_discard_supported = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.reserved_percentage = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.scst_target_driver = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.storage_protocol = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.target_helper = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.target_ip_address = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.target_port = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.target_prefix = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.target_protocol = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.trace_flags = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.unique_fqdn_network = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.use_chap_auth = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.volume_clear = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.volume_clear_ionice = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.volume_clear_size = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] QuobyteHD.volumes_dir = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.ssl = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.ssl_version = {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_notifications.driver = [] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_notifications.retry = -1 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] oslo_messaging_notifications.transport_url = **** {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] key_manager.fixed_key = **** {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican.barbican_api_version = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican.barbican_endpoint = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican.barbican_endpoint_type = public {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican.barbican_region_name = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican.cafile = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican.certfile = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican.collect_timing = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican.insecure = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican.keyfile = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican.number_of_retries = 60 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican.retry_delay = 1 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican.send_service_user_token = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican.split_loggers = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican.timeout = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican.tls_ciphers = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican.tls_min_version = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican.verify_ssl = True {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican.verify_ssl_path = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican_service_user.auth_section = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican_service_user.auth_type = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican_service_user.cafile = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican_service_user.certfile = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican_service_user.collect_timing = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican_service_user.insecure = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican_service_user.keyfile = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican_service_user.split_loggers = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican_service_user.timeout = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican_service_user.tls_ciphers = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] barbican_service_user.tls_min_version = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] vault.approle_role_id = **** {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] vault.approle_secret_id = **** {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] vault.auth_method = approle {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] vault.auth_path = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] vault.kv_mountpoint = secret {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] vault.kv_path = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] vault.kv_version = 2 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] vault.namespace = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] vault.root_token_id = **** {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] vault.ssl_ca_crt_file = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] vault.timeout = 60.0 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] vault.token_file = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] vault.token_role = None {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] vault.use_ssl = False {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 08:12:46 devstack cinder-volume[86505]: DEBUG oslo_service.backend._eventlet.service [None req-e18af2f0-4920-4f3b-84c9-ba7a1537e24c None None] ******************************************************************************** {{(pid=86505) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 08:12:46 devstack sudo[86810]: pam_unix(sudo:session): session closed for user root Nov 03 08:12:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.272s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:12:46 devstack cinder-volume[86801]: INFO cinder.volume.driver [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Driver hasn't implemented _init_vendor_properties() Nov 03 08:12:46 devstack cinder-volume[86801]: DEBUG cinder.volume.driver [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6987686157227, 'free_capacity_gb': 1773.6987686157227, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86801) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 08:12:46 devstack cinder-volume[86801]: DEBUG oslo_db.sqlalchemy.engines [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86801) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 08:12:46 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writer thread running {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 08:12:46 devstack cinder-volume[86801]: DEBUG cinder.db.api [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Building query based on filter {{(pid=86801) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 03 08:12:46 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86801) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 08:12:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:12:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:12:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:12:47 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:12:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:12:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:12:47 devstack cinder-volume[86801]: INFO cinder.keymgr.migration [None req-420ba8ef-796f-49e5-ace0-e2b2307e5ecb None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 08:12:47 devstack sudo[86817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:12:47 devstack sudo[86817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:12:47 devstack sudo[86817]: pam_unix(sudo:session): session closed for user root Nov 03 08:12:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.270s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:12:47 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:12:47 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Driver initialization completed successfully. Nov 03 08:12:47 devstack cinder-volume[86801]: INFO cinder.manager [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Initiating service 3 cleanup Nov 03 08:12:47 devstack cinder-volume[86801]: INFO cinder.manager [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Service 3 cleanup completed. Nov 03 08:12:47 devstack cinder-volume[86801]: DEBUG cinder.service [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Creating RPC server for service cinder-volume {{(pid=86801) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 08:12:47 devstack cinder-volume[86801]: DEBUG cinder.service [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86801) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 08:12:47 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 03 08:12:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:12:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:12:47 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:12:47 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:12:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:12:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:12:47 devstack sudo[86828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:12:47 devstack sudo[86828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:12:47 devstack sudo[86828]: pam_unix(sudo:session): session closed for user root Nov 03 08:12:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.243s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:12:47 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-262f7c57-4bc9-4152-8d35-f1597859cc9c None None] Driver post RPC initialization completed successfully. Nov 03 08:12:56 devstack cinder-volume[86505]: DEBUG dbcounter [-] [86505] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:12:57 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:12:57 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=3 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:13:03 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager._thread_info {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:13:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread count: 6 {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 08:13:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread info: [<_MainThread(MainThread, started 139707544170624)>, , , , , ] {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 08:14:00 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:14:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Flow 'volume_create_manager' (e887d5e3-bbef-4d3b-b893-6d19ae2099a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:14:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88e24cc4-5a7c-454b-a7ad-bce6223412b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:14:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88e24cc4-5a7c-454b-a7ad-bce6223412b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1807650483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=340955c2-05ba-449f-93a0-6898dde1c8f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c2a43a1eec41d39eefc3e2a3b363de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:14:01Z,use_quota=True,user_id='5f33e192a06c405d9d4de5bb1160d4c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:14:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a524ab96-86e4-4808-93e8-2f1b793dae6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:14:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a524ab96-86e4-4808-93e8-2f1b793dae6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:14:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (416718f3-e6f8-457b-9504-f4f9e6b25e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:14:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (416718f3-e6f8-457b-9504-f4f9e6b25e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '340955c2-05ba-449f-93a0-6898dde1c8f3', 'volume_name': 'volume-340955c2-05ba-449f-93a0-6898dde1c8f3', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:14:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b4b953f-b541-4d80-a628-f1747b5d964b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:14:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b4b953f-b541-4d80-a628-f1747b5d964b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:14:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6832fc5b-8c37-445e-837f-cc6444e75d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:14:00 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Volume 340955c2-05ba-449f-93a0-6898dde1c8f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-340955c2-05ba-449f-93a0-6898dde1c8f3', 'volume_size': 1} Nov 03 08:14:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:14:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:14:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1807650483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=340955c2-05ba-449f-93a0-6898dde1c8f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c2a43a1eec41d39eefc3e2a3b363de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:14:01Z,use_quota=True,user_id='5f33e192a06c405d9d4de5bb1160d4c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:14:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Creating volume 340955c2-05ba-449f-93a0-6898dde1c8f3 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:14:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:14:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:14:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:14:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:14:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:14:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:14:00 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:14:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-340955c2-05ba-449f-93a0-6898dde1c8f3 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:14:01 devstack sudo[87560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-340955c2-05ba-449f-93a0-6898dde1c8f3 1073741824 Nov 03 08:14:01 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:14:02 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root Nov 03 08:14:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-340955c2-05ba-449f-93a0-6898dde1c8f3 1073741824" returned: 0 in 1.342s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:14:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-340955c2-05ba-449f-93a0-6898dde1c8f3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:14:02 devstack sudo[87933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-340955c2-05ba-449f-93a0-6898dde1c8f3 Nov 03 08:14:02 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:14:03 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root Nov 03 08:14:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-340955c2-05ba-449f-93a0-6898dde1c8f3" returned: 0 in 0.837s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:14:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] <== create_volume: return (2452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:14:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.459s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:14:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6832fc5b-8c37-445e-837f-cc6444e75d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-340955c2-05ba-449f-93a0-6898dde1c8f3', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:14:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6123c7-d44f-4de2-b3f3-b6c2c06948f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:14:03 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Volume volume-340955c2-05ba-449f-93a0-6898dde1c8f3 (340955c2-05ba-449f-93a0-6898dde1c8f3): created successfully Nov 03 08:14:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6123c7-d44f-4de2-b3f3-b6c2c06948f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:14:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Flow 'volume_create_manager' (e887d5e3-bbef-4d3b-b893-6d19ae2099a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:14:03 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:14:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:14:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:14:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:14:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:14:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:14:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:14:03 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-22811153-abf1-4dce-afff-4b2dcea71c62 tempest-DeleteServersTestJSON-360909536 None] Created volume successfully. Nov 03 08:14:03 devstack sudo[87958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:14:03 devstack sudo[87958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:14:04 devstack sudo[87958]: pam_unix(sudo:session): session closed for user root Nov 03 08:14:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.933s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:14:04 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:14:04 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager._thread_info {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:14:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread count: 6 {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 08:14:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread info: [<_MainThread(MainThread, started 139707544170624)>, , , , , ] {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 08:14:09 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:14:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Flow 'volume_create_manager' (7a0f4a57-1061-477c-abbc-6d38074b0156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:14:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcbdfb4a-ebd3-40ff-8762-b98fa10449f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:14:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcbdfb4a-ebd3-40ff-8762-b98fa10449f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1922127470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1afc3366-7420-4d37-a2c3-409b9d98ee98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9ae99081604e8c9a0de10a053da412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:14:09Z,use_quota=True,user_id='6223a78aa5844c68b41a0b08613c228c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:14:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72bdd02b-573e-403c-b9eb-9b7ceaf5b06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:14:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72bdd02b-573e-403c-b9eb-9b7ceaf5b06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:14:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12e29af-4f56-4461-9e33-0bd8afa7f50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:14:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12e29af-4f56-4461-9e33-0bd8afa7f50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1afc3366-7420-4d37-a2c3-409b9d98ee98', 'volume_name': 'volume-1afc3366-7420-4d37-a2c3-409b9d98ee98', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:14:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdfaae37-00ea-4287-974e-b7c547b501ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:14:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdfaae37-00ea-4287-974e-b7c547b501ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:14:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60d20106-6474-481a-a0ab-fbc9f62d8a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:14:09 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Volume 1afc3366-7420-4d37-a2c3-409b9d98ee98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1afc3366-7420-4d37-a2c3-409b9d98ee98', 'volume_size': 1} Nov 03 08:14:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:14:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:14:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1922127470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1afc3366-7420-4d37-a2c3-409b9d98ee98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9ae99081604e8c9a0de10a053da412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:14:09Z,use_quota=True,user_id='6223a78aa5844c68b41a0b08613c228c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:14:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Creating volume 1afc3366-7420-4d37-a2c3-409b9d98ee98 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:14:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:14:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:14:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:14:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:14:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:14:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:14:09 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:14:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1afc3366-7420-4d37-a2c3-409b9d98ee98 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:14:09 devstack sudo[87979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1afc3366-7420-4d37-a2c3-409b9d98ee98 1073741824 Nov 03 08:14:09 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:14:10 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root Nov 03 08:14:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1afc3366-7420-4d37-a2c3-409b9d98ee98 1073741824" returned: 0 in 1.028s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:14:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1afc3366-7420-4d37-a2c3-409b9d98ee98 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:14:10 devstack sudo[87997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1afc3366-7420-4d37-a2c3-409b9d98ee98 Nov 03 08:14:10 devstack sudo[87997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:14:10 devstack sudo[87997]: pam_unix(sudo:session): session closed for user root Nov 03 08:14:10 devstack cinder-volume[86801]: WARNING py.warnings [req-88b84214-b6b2-48b8-9452-8c92fd578638 req-cadc63e5-ad4f-4fc0-ae9e-491a5d4b4729 tempest-DeleteServersTestJSON-360909536 None] /opt/stack/cinder/cinder/db/api.py:2442: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Nov 03 08:14:10 devstack cinder-volume[86801]: .first() Nov 03 08:14:10 devstack cinder-volume[86801]: Nov 03 08:14:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1afc3366-7420-4d37-a2c3-409b9d98ee98" returned: 0 in 0.497s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:14:10 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:14:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:14:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-88b84214-b6b2-48b8-9452-8c92fd578638 req-cadc63e5-ad4f-4fc0-ae9e-491a5d4b4729 tempest-DeleteServersTestJSON-360909536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:14:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-88b84214-b6b2-48b8-9452-8c92fd578638 req-cadc63e5-ad4f-4fc0-ae9e-491a5d4b4729 tempest-DeleteServersTestJSON-360909536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:14:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-88b84214-b6b2-48b8-9452-8c92fd578638 req-cadc63e5-ad4f-4fc0-ae9e-491a5d4b4729 tempest-DeleteServersTestJSON-360909536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:14:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60d20106-6474-481a-a0ab-fbc9f62d8a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1afc3366-7420-4d37-a2c3-409b9d98ee98', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:14:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d438425-60d9-454b-8c1f-8f446cf5622f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:14:11 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Volume volume-1afc3366-7420-4d37-a2c3-409b9d98ee98 (1afc3366-7420-4d37-a2c3-409b9d98ee98): created successfully Nov 03 08:14:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d438425-60d9-454b-8c1f-8f446cf5622f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:14:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Flow 'volume_create_manager' (7a0f4a57-1061-477c-abbc-6d38074b0156) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:14:11 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-15a23463-89bc-4d3a-9ad5-71b1af537958 tempest-VolumesAdminNegativeTest-1552822778 None] Created volume successfully. Nov 03 08:14:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-88b84214-b6b2-48b8-9452-8c92fd578638 req-cadc63e5-ad4f-4fc0-ae9e-491a5d4b4729 tempest-DeleteServersTestJSON-360909536 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f', 'name': 'volume-340955c2-05ba-449f-93a0-6898dde1c8f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4c03f2ae-4196-41d2-93e6-539c3fe13df4', 'enforce_multipath': True} {{(pid=86801) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 08:14:11 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-88b84214-b6b2-48b8-9452-8c92fd578638 req-cadc63e5-ad4f-4fc0-ae9e-491a5d4b4729 tempest-DeleteServersTestJSON-360909536 None] attachment_update completed successfully. Nov 03 08:14:13 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4e027e44-f0fc-4af5-a1fe-7bc08509f4a7 tempest-VolumesAdminNegativeTest-1552822778 None] Acquiring lock "cinder-1afc3366-7420-4d37-a2c3-409b9d98ee98-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:14:13 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4e027e44-f0fc-4af5-a1fe-7bc08509f4a7 tempest-VolumesAdminNegativeTest-1552822778 None] Lock "cinder-1afc3366-7420-4d37-a2c3-409b9d98ee98-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:14:13 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4e027e44-f0fc-4af5-a1fe-7bc08509f4a7 tempest-VolumesAdminNegativeTest-1552822778 None] Acquiring lock "cinder-quobyte-1afc3366-7420-4d37-a2c3-409b9d98ee98" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:14:13 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4e027e44-f0fc-4af5-a1fe-7bc08509f4a7 tempest-VolumesAdminNegativeTest-1552822778 None] Lock "cinder-quobyte-1afc3366-7420-4d37-a2c3-409b9d98ee98" acquired by "delete_volume" :: waited 0.040s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:14:13 devstack cinder-volume[86801]: INFO oslo.privsep.daemon [None req-4e027e44-f0fc-4af5-a1fe-7bc08509f4a7 tempest-VolumesAdminNegativeTest-1552822778 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp9es2ak1t/privsep.sock'] Nov 03 08:14:13 devstack sudo[88438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp9es2ak1t/privsep.sock Nov 03 08:14:13 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:14:14 devstack cinder-volume[86801]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 03 08:14:14 devstack cinder-volume[86801]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 08:14:14 devstack cinder-volume[86801]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 03 08:14:14 devstack cinder-volume[86801]: WARNING oslo.privsep.daemon [-] privsep log: Nov 03 08:14:14 devstack cinder-volume[86801]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 03 08:14:14 devstack cinder-volume[86801]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 03 08:14:14 devstack cinder-volume[86801]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 08:14:14 devstack cinder-volume[86801]: WARNING oslo.privsep.daemon [-] privsep log: Nov 03 08:14:14 devstack cinder-volume[86801]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 03 08:14:15 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root Nov 03 08:14:15 devstack cinder-volume[86801]: INFO oslo.privsep.daemon [None req-4e027e44-f0fc-4af5-a1fe-7bc08509f4a7 tempest-VolumesAdminNegativeTest-1552822778 None] Spawned new privsep daemon via rootwrap Nov 03 08:14:15 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [None req-4e027e44-f0fc-4af5-a1fe-7bc08509f4a7 tempest-VolumesAdminNegativeTest-1552822778 None] Accepted privsep connection to /tmp/tmp9es2ak1t/privsep.sock {{(pid=86801) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 03 08:14:15 devstack cinder-volume[86801]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 03 08:14:15 devstack cinder-volume[86801]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 03 08:14:15 devstack cinder-volume[86801]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 03 08:14:15 devstack cinder-volume[86801]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88489 Nov 03 08:14:15 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[948b4275-93e0-4e66-b225-f9445f94d52d]: (2,) {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:14:15 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe38bf4b-7d7e-4246-af1b-1e6d0f404545]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:14:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4e027e44-f0fc-4af5-a1fe-7bc08509f4a7 tempest-VolumesAdminNegativeTest-1552822778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1afc3366-7420-4d37-a2c3-409b9d98ee98 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:14:15 devstack sudo[88494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1afc3366-7420-4d37-a2c3-409b9d98ee98 Nov 03 08:14:15 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:14:15 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root Nov 03 08:14:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4e027e44-f0fc-4af5-a1fe-7bc08509f4a7 tempest-VolumesAdminNegativeTest-1552822778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1afc3366-7420-4d37-a2c3-409b9d98ee98" returned: 0 in 0.841s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:14:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4e027e44-f0fc-4af5-a1fe-7bc08509f4a7 tempest-VolumesAdminNegativeTest-1552822778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1afc3366-7420-4d37-a2c3-409b9d98ee98 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:14:16 devstack sudo[88504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1afc3366-7420-4d37-a2c3-409b9d98ee98 Nov 03 08:14:16 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:14:16 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-298ecf2c-3776-4b25-bae6-200f98f3bd26 req-1ae189f9-bd83-4b3d-b487-9520e2343d3f tempest-DeleteServersTestJSON-360909536 None] Terminate volume connection completed successfully. Nov 03 08:14:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-298ecf2c-3776-4b25-bae6-200f98f3bd26 req-1ae189f9-bd83-4b3d-b487-9520e2343d3f tempest-DeleteServersTestJSON-360909536 None] Deleting attachment 4c03f2ae-4196-41d2-93e6-539c3fe13df4. {{(pid=86801) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 08:14:16 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root Nov 03 08:14:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4e027e44-f0fc-4af5-a1fe-7bc08509f4a7 tempest-VolumesAdminNegativeTest-1552822778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1afc3366-7420-4d37-a2c3-409b9d98ee98" returned: 0 in 0.324s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:14:16 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4e027e44-f0fc-4af5-a1fe-7bc08509f4a7 tempest-VolumesAdminNegativeTest-1552822778 None] Lock "cinder-quobyte-1afc3366-7420-4d37-a2c3-409b9d98ee98" released by "delete_volume" :: held 3.088s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:14:16 devstack cinder-volume[86801]: WARNING cinder.quota [None req-4e027e44-f0fc-4af5-a1fe-7bc08509f4a7 tempest-VolumesAdminNegativeTest-1552822778 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:14:16 devstack cinder-volume[86801]: WARNING cinder.quota [None req-4e027e44-f0fc-4af5-a1fe-7bc08509f4a7 tempest-VolumesAdminNegativeTest-1552822778 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:14:16 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-4e027e44-f0fc-4af5-a1fe-7bc08509f4a7 tempest-VolumesAdminNegativeTest-1552822778 None] Created reservations ['ca770c99-d07f-4495-9943-6ee0512b6e45', '09b833c6-eba4-4bc3-9c56-61e1b97aa1e1', '253ad100-9622-4f11-8c76-93fd1eda4d64', 'ab14eae4-6f00-400b-a13c-8a9fe22ed99b'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:14:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4e027e44-f0fc-4af5-a1fe-7bc08509f4a7 tempest-VolumesAdminNegativeTest-1552822778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:14:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4e027e44-f0fc-4af5-a1fe-7bc08509f4a7 tempest-VolumesAdminNegativeTest-1552822778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:14:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4e027e44-f0fc-4af5-a1fe-7bc08509f4a7 tempest-VolumesAdminNegativeTest-1552822778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:14:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4e027e44-f0fc-4af5-a1fe-7bc08509f4a7 tempest-VolumesAdminNegativeTest-1552822778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:14:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4e027e44-f0fc-4af5-a1fe-7bc08509f4a7 tempest-VolumesAdminNegativeTest-1552822778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:14:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4e027e44-f0fc-4af5-a1fe-7bc08509f4a7 tempest-VolumesAdminNegativeTest-1552822778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:14:16 devstack sudo[88507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:14:16 devstack sudo[88507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:14:17 devstack sudo[88507]: pam_unix(sudo:session): session closed for user root Nov 03 08:14:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4e027e44-f0fc-4af5-a1fe-7bc08509f4a7 tempest-VolumesAdminNegativeTest-1552822778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.458s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:14:17 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-4e027e44-f0fc-4af5-a1fe-7bc08509f4a7 tempest-VolumesAdminNegativeTest-1552822778 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:14:17 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-4e027e44-f0fc-4af5-a1fe-7bc08509f4a7 tempest-VolumesAdminNegativeTest-1552822778 None] Deleted volume successfully. Nov 03 08:14:17 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4e027e44-f0fc-4af5-a1fe-7bc08509f4a7 tempest-VolumesAdminNegativeTest-1552822778 None] Lock "cinder-1afc3366-7420-4d37-a2c3-409b9d98ee98-delete_volume" released by "delete_volume" :: held 4.038s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:14:17 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f7596e23-d04f-4826-965d-594fd77a4af2 tempest-DeleteServersTestJSON-360909536 None] Acquiring lock "cinder-340955c2-05ba-449f-93a0-6898dde1c8f3-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:14:17 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f7596e23-d04f-4826-965d-594fd77a4af2 tempest-DeleteServersTestJSON-360909536 None] Lock "cinder-340955c2-05ba-449f-93a0-6898dde1c8f3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:14:17 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f7596e23-d04f-4826-965d-594fd77a4af2 tempest-DeleteServersTestJSON-360909536 None] Acquiring lock "cinder-quobyte-340955c2-05ba-449f-93a0-6898dde1c8f3" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:14:17 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f7596e23-d04f-4826-965d-594fd77a4af2 tempest-DeleteServersTestJSON-360909536 None] Lock "cinder-quobyte-340955c2-05ba-449f-93a0-6898dde1c8f3" acquired by "delete_volume" :: waited 0.030s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:14:17 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[75609280-7542-4949-ad60-0e9c5c9e100c]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:14:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f7596e23-d04f-4826-965d-594fd77a4af2 tempest-DeleteServersTestJSON-360909536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-340955c2-05ba-449f-93a0-6898dde1c8f3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:14:18 devstack sudo[88533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-340955c2-05ba-449f-93a0-6898dde1c8f3 Nov 03 08:14:18 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:14:18 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root Nov 03 08:14:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f7596e23-d04f-4826-965d-594fd77a4af2 tempest-DeleteServersTestJSON-360909536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-340955c2-05ba-449f-93a0-6898dde1c8f3" returned: 0 in 0.405s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:14:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f7596e23-d04f-4826-965d-594fd77a4af2 tempest-DeleteServersTestJSON-360909536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-340955c2-05ba-449f-93a0-6898dde1c8f3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:14:18 devstack sudo[88539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-340955c2-05ba-449f-93a0-6898dde1c8f3 Nov 03 08:14:18 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:14:18 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root Nov 03 08:14:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f7596e23-d04f-4826-965d-594fd77a4af2 tempest-DeleteServersTestJSON-360909536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-340955c2-05ba-449f-93a0-6898dde1c8f3" returned: 0 in 0.325s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:14:18 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f7596e23-d04f-4826-965d-594fd77a4af2 tempest-DeleteServersTestJSON-360909536 None] Lock "cinder-quobyte-340955c2-05ba-449f-93a0-6898dde1c8f3" released by "delete_volume" :: held 0.790s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:14:18 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-f7596e23-d04f-4826-965d-594fd77a4af2 tempest-DeleteServersTestJSON-360909536 None] Created reservations ['49f4104a-06e2-4674-9fc4-8d049274e5a5', '0041fb8a-8d4c-4c90-9631-eed9c2209ec9', '6ba88411-1c4b-4a66-aaff-f2f8a7fa151a', '0b36fbca-5039-49ec-8d4f-ece721fe7629'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:14:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f7596e23-d04f-4826-965d-594fd77a4af2 tempest-DeleteServersTestJSON-360909536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:14:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f7596e23-d04f-4826-965d-594fd77a4af2 tempest-DeleteServersTestJSON-360909536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:14:18 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f7596e23-d04f-4826-965d-594fd77a4af2 tempest-DeleteServersTestJSON-360909536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:14:18 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f7596e23-d04f-4826-965d-594fd77a4af2 tempest-DeleteServersTestJSON-360909536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:14:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f7596e23-d04f-4826-965d-594fd77a4af2 tempest-DeleteServersTestJSON-360909536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:14:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f7596e23-d04f-4826-965d-594fd77a4af2 tempest-DeleteServersTestJSON-360909536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:14:18 devstack sudo[88544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:14:18 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:14:19 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root Nov 03 08:14:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f7596e23-d04f-4826-965d-594fd77a4af2 tempest-DeleteServersTestJSON-360909536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.358s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:14:19 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-f7596e23-d04f-4826-965d-594fd77a4af2 tempest-DeleteServersTestJSON-360909536 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:14:19 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-f7596e23-d04f-4826-965d-594fd77a4af2 tempest-DeleteServersTestJSON-360909536 None] Deleted volume successfully. Nov 03 08:14:19 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f7596e23-d04f-4826-965d-594fd77a4af2 tempest-DeleteServersTestJSON-360909536 None] Lock "cinder-340955c2-05ba-449f-93a0-6898dde1c8f3-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:14:23 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:14:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Flow 'volume_create_manager' (a9fcaf6d-3fdc-4b04-a37b-5f12d3e6844a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:14:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5495eb8a-eed7-4d93-a239-8182b6167058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:14:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5495eb8a-eed7-4d93-a239-8182b6167058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-900188537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58ae0c42-e6a3-405d-8fb8-eca5ce73492f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a71bab2e09f64b1fbaadd3bbe8e61753',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:14:23Z,use_quota=True,user_id='3625b6286a9c42849161eec85f4f1eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:14:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7829a9ed-8a06-4be4-93f3-873b9911e2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:14:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7829a9ed-8a06-4be4-93f3-873b9911e2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:14:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e5fce40-9665-45fa-a3fb-ad30b26a5f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:14:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e5fce40-9665-45fa-a3fb-ad30b26a5f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58ae0c42-e6a3-405d-8fb8-eca5ce73492f', 'volume_name': 'volume-58ae0c42-e6a3-405d-8fb8-eca5ce73492f', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:14:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5eeb491-4265-4282-9ac8-07e39519198b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:14:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5eeb491-4265-4282-9ac8-07e39519198b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:14:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4467d8b5-b00b-4936-8c44-b17a753cda74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:14:23 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Volume 58ae0c42-e6a3-405d-8fb8-eca5ce73492f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58ae0c42-e6a3-405d-8fb8-eca5ce73492f', 'volume_size': 1} Nov 03 08:14:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:14:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:14:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-900188537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58ae0c42-e6a3-405d-8fb8-eca5ce73492f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a71bab2e09f64b1fbaadd3bbe8e61753',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:14:23Z,use_quota=True,user_id='3625b6286a9c42849161eec85f4f1eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:14:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Creating volume 58ae0c42-e6a3-405d-8fb8-eca5ce73492f {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:14:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:14:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:14:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:14:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:14:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:14:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:14:23 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:14:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-58ae0c42-e6a3-405d-8fb8-eca5ce73492f 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:14:23 devstack sudo[88554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-58ae0c42-e6a3-405d-8fb8-eca5ce73492f 1073741824 Nov 03 08:14:23 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:14:24 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root Nov 03 08:14:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-58ae0c42-e6a3-405d-8fb8-eca5ce73492f 1073741824" returned: 0 in 0.517s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:14:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-58ae0c42-e6a3-405d-8fb8-eca5ce73492f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:14:24 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-58ae0c42-e6a3-405d-8fb8-eca5ce73492f Nov 03 08:14:24 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:14:24 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Nov 03 08:14:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-58ae0c42-e6a3-405d-8fb8-eca5ce73492f" returned: 0 in 0.292s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:14:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:14:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:14:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4467d8b5-b00b-4936-8c44-b17a753cda74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58ae0c42-e6a3-405d-8fb8-eca5ce73492f', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:14:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (886b8251-650d-43fd-8b21-399aec57e5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:14:24 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Volume volume-58ae0c42-e6a3-405d-8fb8-eca5ce73492f (58ae0c42-e6a3-405d-8fb8-eca5ce73492f): created successfully Nov 03 08:14:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (886b8251-650d-43fd-8b21-399aec57e5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:14:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Flow 'volume_create_manager' (a9fcaf6d-3fdc-4b04-a37b-5f12d3e6844a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:14:24 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-f198f7ff-1566-481b-bcef-192a06d756bc tempest-AttachVolumeShelveTestJSON-968364421 None] Created volume successfully. Nov 03 08:14:34 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:UPDATE=26,cinder:SELECT=25,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:14:34 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=22,cinder:INSERT=6,cinder:UPDATE=27,cinder:DELETE=3 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:14:49 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-10f1d8d7-5996-4ab9-b7c3-234b9940bef6 req-4441864b-667b-4965-8d87-4fb15b00e9c9 tempest-AttachVolumeShelveTestJSON-968364421 None] No connector for attachment 7b734ff9-39d0-4f11-a3d7-749a5d661dce; skipping storage backend terminate_connection call. {{(pid=86801) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 03 08:14:49 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-10f1d8d7-5996-4ab9-b7c3-234b9940bef6 req-4441864b-667b-4965-8d87-4fb15b00e9c9 tempest-AttachVolumeShelveTestJSON-968364421 None] Deleting attachment 7b734ff9-39d0-4f11-a3d7-749a5d661dce. {{(pid=86801) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 08:14:59 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:14:59 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=2 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:15:03 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:15:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:15:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:15:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:15:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:15:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:15:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:15:03 devstack sudo[88711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:15:03 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:15:03 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root Nov 03 08:15:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.303s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:15:04 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:15:04 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager._thread_info {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:15:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread count: 8 {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 08:15:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread info: [<_MainThread(MainThread, started 139707544170624)>, , , , , , , ] {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 08:15:06 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:15:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Flow 'volume_create_manager' (3bf58eef-f9a2-4ed2-9749-3b9ea8df8b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:15:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bff26c4e-64d1-42f7-bce0-78b87411cc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:15:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bff26c4e-64d1-42f7-bce0-78b87411cc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1104460972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1875d7b0-7d1d-4881-9378-b19e7a96c1d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='982b0c3353684f86bd698c91f0525fab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:15:06Z,use_quota=True,user_id='fc1211fc4cdd46c08532bad9017bd208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:15:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4c01b0-7a28-4a95-8c91-18ebfdefb8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:15:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4c01b0-7a28-4a95-8c91-18ebfdefb8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:15:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e2c7d2-6cee-4606-beb9-d145d719070f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:15:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e2c7d2-6cee-4606-beb9-d145d719070f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1875d7b0-7d1d-4881-9378-b19e7a96c1d3', 'volume_name': 'volume-1875d7b0-7d1d-4881-9378-b19e7a96c1d3', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:15:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (938281e9-7a6a-4d3f-afc3-73846f017a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:15:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (938281e9-7a6a-4d3f-afc3-73846f017a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:15:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4476b50-fc1e-45b6-852f-1f8028719d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:15:06 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Volume 1875d7b0-7d1d-4881-9378-b19e7a96c1d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1875d7b0-7d1d-4881-9378-b19e7a96c1d3', 'volume_size': 1} Nov 03 08:15:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:15:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:15:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1104460972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1875d7b0-7d1d-4881-9378-b19e7a96c1d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='982b0c3353684f86bd698c91f0525fab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:15:06Z,use_quota=True,user_id='fc1211fc4cdd46c08532bad9017bd208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:15:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Creating volume 1875d7b0-7d1d-4881-9378-b19e7a96c1d3 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:15:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:15:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:15:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:15:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:15:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:15:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:15:06 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:15:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1875d7b0-7d1d-4881-9378-b19e7a96c1d3 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:15:06 devstack sudo[88783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1875d7b0-7d1d-4881-9378-b19e7a96c1d3 1073741824 Nov 03 08:15:06 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:15:07 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root Nov 03 08:15:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1875d7b0-7d1d-4881-9378-b19e7a96c1d3 1073741824" returned: 0 in 1.026s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:15:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1875d7b0-7d1d-4881-9378-b19e7a96c1d3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:15:07 devstack sudo[88793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1875d7b0-7d1d-4881-9378-b19e7a96c1d3 Nov 03 08:15:07 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:15:08 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root Nov 03 08:15:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1875d7b0-7d1d-4881-9378-b19e7a96c1d3" returned: 0 in 0.433s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:15:08 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:15:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:15:08 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4476b50-fc1e-45b6-852f-1f8028719d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1875d7b0-7d1d-4881-9378-b19e7a96c1d3', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:15:08 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64274d57-117a-41ba-9d5e-5d84c3dbc42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:15:08 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Volume volume-1875d7b0-7d1d-4881-9378-b19e7a96c1d3 (1875d7b0-7d1d-4881-9378-b19e7a96c1d3): created successfully Nov 03 08:15:08 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64274d57-117a-41ba-9d5e-5d84c3dbc42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:15:08 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Flow 'volume_create_manager' (3bf58eef-f9a2-4ed2-9749-3b9ea8df8b62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:15:08 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-4bce022d-4db5-4051-a31c-9259d4815253 tempest-TaggedAttachmentsTest-359524230 None] Created volume successfully. Nov 03 08:15:18 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:INSERT=1 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:15:18 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:15:31 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:15:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Flow 'volume_create_manager' (97c745ed-7f9f-4852-a228-98d719408195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:15:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3b7fac-1db3-4181-87f6-a56c13516e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:15:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3b7fac-1db3-4181-87f6-a56c13516e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2137754506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f501da-f217-4cab-b6ed-7ec0492f45b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c4b94442a84a1eb7c1695724c98b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:15:31Z,use_quota=True,user_id='5c26bbe18fa44999abaf63d74d22ef26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:15:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15cc177f-7e03-4b00-bef0-f963047944b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:15:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15cc177f-7e03-4b00-bef0-f963047944b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:15:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0d00b1-5ad3-47d9-8582-8dede2fb2938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:15:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0d00b1-5ad3-47d9-8582-8dede2fb2938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36f501da-f217-4cab-b6ed-7ec0492f45b6', 'volume_name': 'volume-36f501da-f217-4cab-b6ed-7ec0492f45b6', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:15:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9626a2c-4c74-4598-991d-ff70b05109a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:15:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9626a2c-4c74-4598-991d-ff70b05109a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:15:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af0e3a6-1606-44fb-83c7-9a1bf41f56c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:15:31 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Volume 36f501da-f217-4cab-b6ed-7ec0492f45b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36f501da-f217-4cab-b6ed-7ec0492f45b6', 'volume_size': 1} Nov 03 08:15:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:15:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:15:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2137754506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f501da-f217-4cab-b6ed-7ec0492f45b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c4b94442a84a1eb7c1695724c98b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:15:31Z,use_quota=True,user_id='5c26bbe18fa44999abaf63d74d22ef26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:15:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Creating volume 36f501da-f217-4cab-b6ed-7ec0492f45b6 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:15:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:15:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:15:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:15:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:15:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:15:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:15:31 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:15:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-36f501da-f217-4cab-b6ed-7ec0492f45b6 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:15:31 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-36f501da-f217-4cab-b6ed-7ec0492f45b6 1073741824 Nov 03 08:15:31 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:15:32 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Nov 03 08:15:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-36f501da-f217-4cab-b6ed-7ec0492f45b6 1073741824" returned: 0 in 0.695s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:15:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-36f501da-f217-4cab-b6ed-7ec0492f45b6 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:15:32 devstack sudo[89165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-36f501da-f217-4cab-b6ed-7ec0492f45b6 Nov 03 08:15:32 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:15:32 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root Nov 03 08:15:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-36f501da-f217-4cab-b6ed-7ec0492f45b6" returned: 0 in 0.427s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:15:32 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:15:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:15:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af0e3a6-1606-44fb-83c7-9a1bf41f56c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36f501da-f217-4cab-b6ed-7ec0492f45b6', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:15:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2400e93e-19bf-4a51-bf40-e272998fc567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:15:32 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Volume volume-36f501da-f217-4cab-b6ed-7ec0492f45b6 (36f501da-f217-4cab-b6ed-7ec0492f45b6): created successfully Nov 03 08:15:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2400e93e-19bf-4a51-bf40-e272998fc567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:15:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Flow 'volume_create_manager' (97c745ed-7f9f-4852-a228-98d719408195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:15:32 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-5dae7255-27ad-4434-9c69-d8855e3ff805 tempest-ServerActionsTestOtherA-191550997 None] Created volume successfully. Nov 03 08:15:42 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:15:42 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:15:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-fe358d2b-6900-463b-82a5-4ece00db73db tempest-AttachVolumeShelveTestJSON-968364421 None] Acquiring lock "cinder-58ae0c42-e6a3-405d-8fb8-eca5ce73492f-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:15:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-fe358d2b-6900-463b-82a5-4ece00db73db tempest-AttachVolumeShelveTestJSON-968364421 None] Lock "cinder-58ae0c42-e6a3-405d-8fb8-eca5ce73492f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:15:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-fe358d2b-6900-463b-82a5-4ece00db73db tempest-AttachVolumeShelveTestJSON-968364421 None] Acquiring lock "cinder-quobyte-58ae0c42-e6a3-405d-8fb8-eca5ce73492f" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:15:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-fe358d2b-6900-463b-82a5-4ece00db73db tempest-AttachVolumeShelveTestJSON-968364421 None] Lock "cinder-quobyte-58ae0c42-e6a3-405d-8fb8-eca5ce73492f" acquired by "delete_volume" :: waited 0.014s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:15:47 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e9a51f-2efb-4559-a019-0e722dc130a1]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:15:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fe358d2b-6900-463b-82a5-4ece00db73db tempest-AttachVolumeShelveTestJSON-968364421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-58ae0c42-e6a3-405d-8fb8-eca5ce73492f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:15:47 devstack sudo[89354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-58ae0c42-e6a3-405d-8fb8-eca5ce73492f Nov 03 08:15:47 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:15:47 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root Nov 03 08:15:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fe358d2b-6900-463b-82a5-4ece00db73db tempest-AttachVolumeShelveTestJSON-968364421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-58ae0c42-e6a3-405d-8fb8-eca5ce73492f" returned: 0 in 0.333s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:15:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fe358d2b-6900-463b-82a5-4ece00db73db tempest-AttachVolumeShelveTestJSON-968364421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-58ae0c42-e6a3-405d-8fb8-eca5ce73492f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:15:47 devstack sudo[89359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-58ae0c42-e6a3-405d-8fb8-eca5ce73492f Nov 03 08:15:47 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:15:48 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root Nov 03 08:15:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fe358d2b-6900-463b-82a5-4ece00db73db tempest-AttachVolumeShelveTestJSON-968364421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-58ae0c42-e6a3-405d-8fb8-eca5ce73492f" returned: 0 in 0.274s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:15:48 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-fe358d2b-6900-463b-82a5-4ece00db73db tempest-AttachVolumeShelveTestJSON-968364421 None] Lock "cinder-quobyte-58ae0c42-e6a3-405d-8fb8-eca5ce73492f" released by "delete_volume" :: held 0.651s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:15:48 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-fe358d2b-6900-463b-82a5-4ece00db73db tempest-AttachVolumeShelveTestJSON-968364421 None] Created reservations ['93800d00-130b-4332-8582-4fae7449a371', '7a5fde5b-2fce-45ab-bb9d-60b4697ad34d', '8ce0ac2c-0158-4ab4-94ee-53bc3efdde1e', '42c6fc47-cadc-44d9-929f-abdb002f6503'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:15:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fe358d2b-6900-463b-82a5-4ece00db73db tempest-AttachVolumeShelveTestJSON-968364421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:15:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fe358d2b-6900-463b-82a5-4ece00db73db tempest-AttachVolumeShelveTestJSON-968364421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:15:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fe358d2b-6900-463b-82a5-4ece00db73db tempest-AttachVolumeShelveTestJSON-968364421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:15:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fe358d2b-6900-463b-82a5-4ece00db73db tempest-AttachVolumeShelveTestJSON-968364421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:15:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fe358d2b-6900-463b-82a5-4ece00db73db tempest-AttachVolumeShelveTestJSON-968364421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:15:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fe358d2b-6900-463b-82a5-4ece00db73db tempest-AttachVolumeShelveTestJSON-968364421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:15:48 devstack sudo[89363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:15:48 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:15:48 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root Nov 03 08:15:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fe358d2b-6900-463b-82a5-4ece00db73db tempest-AttachVolumeShelveTestJSON-968364421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.255s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:15:48 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-fe358d2b-6900-463b-82a5-4ece00db73db tempest-AttachVolumeShelveTestJSON-968364421 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:15:48 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-fe358d2b-6900-463b-82a5-4ece00db73db tempest-AttachVolumeShelveTestJSON-968364421 None] Deleted volume successfully. Nov 03 08:15:48 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-fe358d2b-6900-463b-82a5-4ece00db73db tempest-AttachVolumeShelveTestJSON-968364421 None] Lock "cinder-58ae0c42-e6a3-405d-8fb8-eca5ce73492f-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:15:58 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:15:58 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:UPDATE=8,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:16:03 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:16:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:16:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:16:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:16:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:16:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:16:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:16:03 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:16:03 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:16:03 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:16:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Flow 'volume_create_manager' (68570a20-f420-4fd9-930d-f9e5552702f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:16:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a0c4c35-50da-4f63-ae05-2a1c449b95e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a0c4c35-50da-4f63-ae05-2a1c449b95e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1413254114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c776ed4-2e89-41eb-8a65-5b97a51ca51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af19262e4f3a447e93cf24682613a39f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:16:04Z,use_quota=True,user_id='1655eec14a10467c8f5225f2e985c5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a33f848-feae-40c7-8460-46b1b7421870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a33f848-feae-40c7-8460-46b1b7421870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:16:04 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb81c04b-b635-466b-b684-250b6c0f5575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb81c04b-b635-466b-b684-250b6c0f5575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c776ed4-2e89-41eb-8a65-5b97a51ca51e', 'volume_name': 'volume-8c776ed4-2e89-41eb-8a65-5b97a51ca51e', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09d5e418-978c-4fd3-9c10-7029e2781393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09d5e418-978c-4fd3-9c10-7029e2781393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b0206a5-794a-4667-8550-50c6298236ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:16:04 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Volume 8c776ed4-2e89-41eb-8a65-5b97a51ca51e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c776ed4-2e89-41eb-8a65-5b97a51ca51e', 'volume_size': 1} Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1413254114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c776ed4-2e89-41eb-8a65-5b97a51ca51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af19262e4f3a447e93cf24682613a39f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:16:04Z,use_quota=True,user_id='1655eec14a10467c8f5225f2e985c5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Creating volume 8c776ed4-2e89-41eb-8a65-5b97a51ca51e {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:16:04 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8c776ed4-2e89-41eb-8a65-5b97a51ca51e 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.375s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager._thread_info {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread count: 8 {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread info: [<_MainThread(MainThread, started 139707544170624)>, , , , , , , ] {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 08:16:04 devstack sudo[89442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8c776ed4-2e89-41eb-8a65-5b97a51ca51e 1073741824 Nov 03 08:16:04 devstack sudo[89442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:16:04 devstack sudo[89442]: pam_unix(sudo:session): session closed for user root Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8c776ed4-2e89-41eb-8a65-5b97a51ca51e 1073741824" returned: 0 in 0.474s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8c776ed4-2e89-41eb-8a65-5b97a51ca51e {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:16:04 devstack sudo[89448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8c776ed4-2e89-41eb-8a65-5b97a51ca51e Nov 03 08:16:04 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:16:04 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8c776ed4-2e89-41eb-8a65-5b97a51ca51e" returned: 0 in 0.262s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b0206a5-794a-4667-8550-50c6298236ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c776ed4-2e89-41eb-8a65-5b97a51ca51e', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c65644-e2e6-4a10-a84e-442b3a1b3648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:16:04 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Volume volume-8c776ed4-2e89-41eb-8a65-5b97a51ca51e (8c776ed4-2e89-41eb-8a65-5b97a51ca51e): created successfully Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c65644-e2e6-4a10-a84e-442b3a1b3648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:16:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Flow 'volume_create_manager' (68570a20-f420-4fd9-930d-f9e5552702f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:16:04 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-d6e71fbe-61a9-4c24-abfd-f8d62894cada tempest-AttachVolumeTestJSON-615484012 None] Created volume successfully. Nov 03 08:16:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-3144d448-f323-4295-9f35-e21782af1c30 req-9f8040a6-a4e8-4493-9fb4-a7d8fd48f274 tempest-AttachVolumeTestJSON-615484012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:16:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-3144d448-f323-4295-9f35-e21782af1c30 req-9f8040a6-a4e8-4493-9fb4-a7d8fd48f274 tempest-AttachVolumeTestJSON-615484012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:16:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-3144d448-f323-4295-9f35-e21782af1c30 req-9f8040a6-a4e8-4493-9fb4-a7d8fd48f274 tempest-AttachVolumeTestJSON-615484012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:16:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-3144d448-f323-4295-9f35-e21782af1c30 req-9f8040a6-a4e8-4493-9fb4-a7d8fd48f274 tempest-AttachVolumeTestJSON-615484012 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f', 'name': 'volume-8c776ed4-2e89-41eb-8a65-5b97a51ca51e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b564fd5c-2d1d-4c04-8f04-ccddef4f315b', 'enforce_multipath': True} {{(pid=86801) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 08:16:05 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-3144d448-f323-4295-9f35-e21782af1c30 req-9f8040a6-a4e8-4493-9fb4-a7d8fd48f274 tempest-AttachVolumeTestJSON-615484012 None] attachment_update completed successfully. Nov 03 08:16:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-80a67e03-a19d-4ca3-8e17-dfd5d66e52f3 req-5d1456ee-d177-4c21-a542-2ccb13351fc4 tempest-ServerActionsTestOtherA-191550997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:16:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-80a67e03-a19d-4ca3-8e17-dfd5d66e52f3 req-5d1456ee-d177-4c21-a542-2ccb13351fc4 tempest-ServerActionsTestOtherA-191550997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:16:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-80a67e03-a19d-4ca3-8e17-dfd5d66e52f3 req-5d1456ee-d177-4c21-a542-2ccb13351fc4 tempest-ServerActionsTestOtherA-191550997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:16:08 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-80a67e03-a19d-4ca3-8e17-dfd5d66e52f3 req-5d1456ee-d177-4c21-a542-2ccb13351fc4 tempest-ServerActionsTestOtherA-191550997 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f', 'name': 'volume-36f501da-f217-4cab-b6ed-7ec0492f45b6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc5ffe5a-a890-45b4-9877-dab3ab19603f', 'enforce_multipath': True} {{(pid=86801) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 08:16:08 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-80a67e03-a19d-4ca3-8e17-dfd5d66e52f3 req-5d1456ee-d177-4c21-a542-2ccb13351fc4 tempest-ServerActionsTestOtherA-191550997 None] attachment_update completed successfully. Nov 03 08:16:15 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-4f55bb65-e9fc-4100-a015-12946ebad570 req-0c189799-af22-4f0b-8880-ccae7139b953 tempest-ServerActionsTestOtherA-191550997 None] Terminate volume connection completed successfully. Nov 03 08:16:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-4f55bb65-e9fc-4100-a015-12946ebad570 req-0c189799-af22-4f0b-8880-ccae7139b953 tempest-ServerActionsTestOtherA-191550997 None] Deleting attachment fc5ffe5a-a890-45b4-9877-dab3ab19603f. {{(pid=86801) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 08:16:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-44483efa-bd8f-4efa-b005-1a7c704f9cc5 req-46d45fea-6b5a-4253-927f-d49d3a805a5d tempest-TaggedAttachmentsTest-359524230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:16:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-44483efa-bd8f-4efa-b005-1a7c704f9cc5 req-46d45fea-6b5a-4253-927f-d49d3a805a5d tempest-TaggedAttachmentsTest-359524230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:16:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-44483efa-bd8f-4efa-b005-1a7c704f9cc5 req-46d45fea-6b5a-4253-927f-d49d3a805a5d tempest-TaggedAttachmentsTest-359524230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:16:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-44483efa-bd8f-4efa-b005-1a7c704f9cc5 req-46d45fea-6b5a-4253-927f-d49d3a805a5d tempest-TaggedAttachmentsTest-359524230 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f', 'name': 'volume-1875d7b0-7d1d-4881-9378-b19e7a96c1d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b543a810-5b29-4e80-a958-b7458c64a0d2', 'enforce_multipath': True} {{(pid=86801) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 08:16:17 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-44483efa-bd8f-4efa-b005-1a7c704f9cc5 req-46d45fea-6b5a-4253-927f-d49d3a805a5d tempest-TaggedAttachmentsTest-359524230 None] attachment_update completed successfully. Nov 03 08:16:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-4f55bb65-e9fc-4100-a015-12946ebad570 req-fc39694f-883c-4f2d-bd12-6d9faa6b9a28 tempest-ServerActionsTestOtherA-191550997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:16:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-4f55bb65-e9fc-4100-a015-12946ebad570 req-fc39694f-883c-4f2d-bd12-6d9faa6b9a28 tempest-ServerActionsTestOtherA-191550997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:16:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-4f55bb65-e9fc-4100-a015-12946ebad570 req-fc39694f-883c-4f2d-bd12-6d9faa6b9a28 tempest-ServerActionsTestOtherA-191550997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:16:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-4f55bb65-e9fc-4100-a015-12946ebad570 req-fc39694f-883c-4f2d-bd12-6d9faa6b9a28 tempest-ServerActionsTestOtherA-191550997 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f', 'name': 'volume-36f501da-f217-4cab-b6ed-7ec0492f45b6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8fd51bac-3d09-4df9-a86a-903e017ce7ae', 'enforce_multipath': True} {{(pid=86801) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 08:16:18 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-4f55bb65-e9fc-4100-a015-12946ebad570 req-fc39694f-883c-4f2d-bd12-6d9faa6b9a28 tempest-ServerActionsTestOtherA-191550997 None] attachment_update completed successfully. Nov 03 08:16:22 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-15b7a234-3cdb-46f7-9d00-4803844a5dcc req-a7c13056-80a6-4c30-b7e7-feb064a14109 tempest-TaggedAttachmentsTest-359524230 None] Terminate volume connection completed successfully. Nov 03 08:16:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-15b7a234-3cdb-46f7-9d00-4803844a5dcc req-a7c13056-80a6-4c30-b7e7-feb064a14109 tempest-TaggedAttachmentsTest-359524230 None] Deleting attachment b543a810-5b29-4e80-a958-b7458c64a0d2. {{(pid=86801) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 08:16:32 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:UPDATE=9,cinder:SELECT=31,cinder:INSERT=1 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:16:32 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=29,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:16:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6634e448-4c03-42d8-b2c1-c50769c51f44 tempest-TaggedAttachmentsTest-359524230 None] Acquiring lock "cinder-1875d7b0-7d1d-4881-9378-b19e7a96c1d3-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:16:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6634e448-4c03-42d8-b2c1-c50769c51f44 tempest-TaggedAttachmentsTest-359524230 None] Lock "cinder-1875d7b0-7d1d-4881-9378-b19e7a96c1d3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:16:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6634e448-4c03-42d8-b2c1-c50769c51f44 tempest-TaggedAttachmentsTest-359524230 None] Acquiring lock "cinder-quobyte-1875d7b0-7d1d-4881-9378-b19e7a96c1d3" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:16:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6634e448-4c03-42d8-b2c1-c50769c51f44 tempest-TaggedAttachmentsTest-359524230 None] Lock "cinder-quobyte-1875d7b0-7d1d-4881-9378-b19e7a96c1d3" acquired by "delete_volume" :: waited 0.021s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:16:34 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85dc2a7-2871-4260-87fc-c4b9f74da31b]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:16:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6634e448-4c03-42d8-b2c1-c50769c51f44 tempest-TaggedAttachmentsTest-359524230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1875d7b0-7d1d-4881-9378-b19e7a96c1d3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:16:34 devstack sudo[90902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1875d7b0-7d1d-4881-9378-b19e7a96c1d3 Nov 03 08:16:34 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:16:35 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root Nov 03 08:16:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6634e448-4c03-42d8-b2c1-c50769c51f44 tempest-TaggedAttachmentsTest-359524230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1875d7b0-7d1d-4881-9378-b19e7a96c1d3" returned: 0 in 0.399s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:16:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6634e448-4c03-42d8-b2c1-c50769c51f44 tempest-TaggedAttachmentsTest-359524230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1875d7b0-7d1d-4881-9378-b19e7a96c1d3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:16:35 devstack sudo[90907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1875d7b0-7d1d-4881-9378-b19e7a96c1d3 Nov 03 08:16:35 devstack sudo[90907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:16:35 devstack sudo[90907]: pam_unix(sudo:session): session closed for user root Nov 03 08:16:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6634e448-4c03-42d8-b2c1-c50769c51f44 tempest-TaggedAttachmentsTest-359524230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1875d7b0-7d1d-4881-9378-b19e7a96c1d3" returned: 0 in 0.271s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:16:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6634e448-4c03-42d8-b2c1-c50769c51f44 tempest-TaggedAttachmentsTest-359524230 None] Lock "cinder-quobyte-1875d7b0-7d1d-4881-9378-b19e7a96c1d3" released by "delete_volume" :: held 0.718s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:16:35 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-6634e448-4c03-42d8-b2c1-c50769c51f44 tempest-TaggedAttachmentsTest-359524230 None] Created reservations ['d9dd9353-87c4-4aca-ae06-4716575b2fb8', '8c4fec1a-f1a5-4bdf-8a8c-4cdb83087a64', '76ffd14e-4889-48b7-ba74-36a3988e82ee', '74942720-0656-42b3-bdca-97492d5e4fc3'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:16:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6634e448-4c03-42d8-b2c1-c50769c51f44 tempest-TaggedAttachmentsTest-359524230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:16:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6634e448-4c03-42d8-b2c1-c50769c51f44 tempest-TaggedAttachmentsTest-359524230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:16:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6634e448-4c03-42d8-b2c1-c50769c51f44 tempest-TaggedAttachmentsTest-359524230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:16:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6634e448-4c03-42d8-b2c1-c50769c51f44 tempest-TaggedAttachmentsTest-359524230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:16:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6634e448-4c03-42d8-b2c1-c50769c51f44 tempest-TaggedAttachmentsTest-359524230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:16:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6634e448-4c03-42d8-b2c1-c50769c51f44 tempest-TaggedAttachmentsTest-359524230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:16:35 devstack sudo[90910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:16:35 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:16:35 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root Nov 03 08:16:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6634e448-4c03-42d8-b2c1-c50769c51f44 tempest-TaggedAttachmentsTest-359524230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.301s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:16:35 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-6634e448-4c03-42d8-b2c1-c50769c51f44 tempest-TaggedAttachmentsTest-359524230 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:16:35 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-6634e448-4c03-42d8-b2c1-c50769c51f44 tempest-TaggedAttachmentsTest-359524230 None] Deleted volume successfully. Nov 03 08:16:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6634e448-4c03-42d8-b2c1-c50769c51f44 tempest-TaggedAttachmentsTest-359524230 None] Lock "cinder-1875d7b0-7d1d-4881-9378-b19e7a96c1d3-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:16:43 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:16:43 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Flow 'volume_create_manager' (18bc3e60-ca10-4bf5-939c-31c43b665e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:16:43 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa99aa1-c69c-434d-a097-a614c15ab71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:16:43 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa99aa1-c69c-434d-a097-a614c15ab71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-614715437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e358676-9dab-4956-8bdf-cf3cdc3b827d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1aed2ea7e845bbb65bba40dde65fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:16:44Z,use_quota=True,user_id='f81cdd381f0148b7adc87126ea95b1b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:16:43 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4557322-8d0c-4a39-807c-0d96f0acb0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:16:43 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4557322-8d0c-4a39-807c-0d96f0acb0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:16:43 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eb41bb3-47ec-46c4-9ec6-283475dc6dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:16:43 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eb41bb3-47ec-46c4-9ec6-283475dc6dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e358676-9dab-4956-8bdf-cf3cdc3b827d', 'volume_name': 'volume-4e358676-9dab-4956-8bdf-cf3cdc3b827d', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:16:43 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc2abc2-4d39-4faa-938f-d1d8cd77cebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:16:43 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc2abc2-4d39-4faa-938f-d1d8cd77cebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:16:43 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4df79351-2a9e-4331-98df-0398e487fbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:16:43 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Volume 4e358676-9dab-4956-8bdf-cf3cdc3b827d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e358676-9dab-4956-8bdf-cf3cdc3b827d', 'volume_size': 1} Nov 03 08:16:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:16:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:16:43 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-614715437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e358676-9dab-4956-8bdf-cf3cdc3b827d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1aed2ea7e845bbb65bba40dde65fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:16:44Z,use_quota=True,user_id='f81cdd381f0148b7adc87126ea95b1b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:16:43 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Creating volume 4e358676-9dab-4956-8bdf-cf3cdc3b827d {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:16:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:16:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:16:43 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:16:43 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:16:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:16:43 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:16:43 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:16:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4e358676-9dab-4956-8bdf-cf3cdc3b827d 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:16:43 devstack sudo[90971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4e358676-9dab-4956-8bdf-cf3cdc3b827d 1073741824 Nov 03 08:16:43 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:16:44 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root Nov 03 08:16:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4e358676-9dab-4956-8bdf-cf3cdc3b827d 1073741824" returned: 0 in 0.449s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:16:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4e358676-9dab-4956-8bdf-cf3cdc3b827d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:16:44 devstack sudo[90977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4e358676-9dab-4956-8bdf-cf3cdc3b827d Nov 03 08:16:44 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:16:44 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root Nov 03 08:16:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4e358676-9dab-4956-8bdf-cf3cdc3b827d" returned: 0 in 0.322s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:16:44 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:16:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:16:44 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4df79351-2a9e-4331-98df-0398e487fbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e358676-9dab-4956-8bdf-cf3cdc3b827d', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:16:44 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114f64fc-a7a7-4467-bfd2-1090d189adea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:16:44 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Volume volume-4e358676-9dab-4956-8bdf-cf3cdc3b827d (4e358676-9dab-4956-8bdf-cf3cdc3b827d): created successfully Nov 03 08:16:44 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114f64fc-a7a7-4467-bfd2-1090d189adea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:16:44 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Flow 'volume_create_manager' (18bc3e60-ca10-4bf5-939c-31c43b665e0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:16:44 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-250230b1-7c88-4b87-9f8e-cd75537192c2 tempest-AttachVolumeNegativeTest-1934443952 None] Created volume successfully. Nov 03 08:16:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-c5d60dd6-bff2-4827-ae68-93c1b1ac72fe req-8bf8b388-98ad-4e3a-93a7-86ec397e4a32 tempest-AttachVolumeNegativeTest-1934443952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:16:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-c5d60dd6-bff2-4827-ae68-93c1b1ac72fe req-8bf8b388-98ad-4e3a-93a7-86ec397e4a32 tempest-AttachVolumeNegativeTest-1934443952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:16:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-c5d60dd6-bff2-4827-ae68-93c1b1ac72fe req-8bf8b388-98ad-4e3a-93a7-86ec397e4a32 tempest-AttachVolumeNegativeTest-1934443952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:16:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-c5d60dd6-bff2-4827-ae68-93c1b1ac72fe req-8bf8b388-98ad-4e3a-93a7-86ec397e4a32 tempest-AttachVolumeNegativeTest-1934443952 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f', 'name': 'volume-4e358676-9dab-4956-8bdf-cf3cdc3b827d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8228321e-2ea2-47a5-8765-b4923bd3326b', 'enforce_multipath': True} {{(pid=86801) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 08:16:46 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-c5d60dd6-bff2-4827-ae68-93c1b1ac72fe req-8bf8b388-98ad-4e3a-93a7-86ec397e4a32 tempest-AttachVolumeNegativeTest-1934443952 None] attachment_update completed successfully. Nov 03 08:16:50 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-11b42d6d-2f5b-48e1-a80a-87c476d7b230 req-57d98bf8-2bb6-4c4d-9a65-30e5bdf90ad3 tempest-ServerActionsTestOtherA-191550997 None] Terminate volume connection completed successfully. Nov 03 08:16:50 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-11b42d6d-2f5b-48e1-a80a-87c476d7b230 req-57d98bf8-2bb6-4c4d-9a65-30e5bdf90ad3 tempest-ServerActionsTestOtherA-191550997 None] Deleting attachment 8fd51bac-3d09-4df9-a86a-903e017ce7ae. {{(pid=86801) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 08:16:57 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=15,cinder:INSERT=2,cinder:UPDATE=10,cinder:DELETE=2 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:17:00 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=15,cinder:UPDATE=16,cinder:INSERT=3 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:17:03 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:17:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Flow 'volume_create_manager' (d0e0c21f-5974-4ca8-93b6-6df9461dd946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:17:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd23bc7-c612-4821-910a-d432906303f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:17:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd23bc7-c612-4821-910a-d432906303f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-227121953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8986f984-24d9-491c-834c-89dcfd9fd0ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c4b94442a84a1eb7c1695724c98b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:17:03Z,use_quota=True,user_id='5c26bbe18fa44999abaf63d74d22ef26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:17:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ffe342-230b-47c3-bda8-acb4c1552a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:17:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ffe342-230b-47c3-bda8-acb4c1552a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:17:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fe4dea1-8b40-41c7-bf34-745b7e209dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:17:03 devstack cinder-volume[86801]: DEBUG cinder.image.glance [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Creating Keystone auth plugin from conf {{(pid=86801) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 08:17:03 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:17:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:17:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:17:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:17:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:17:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:17:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:17:03 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:17:03 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:17:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fe4dea1-8b40-41c7-bf34-745b7e209dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8986f984-24d9-491c-834c-89dcfd9fd0ff', 'volume_name': 'volume-8986f984-24d9-491c-834c-89dcfd9fd0ff', 'volume_size': 1, 'image_id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02c779626a284994918db1738b55fe79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'created_at': datetime.datetime(2026, 11, 3, 7, 8, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 8, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9eb5e936-be4c-46be-8de8-899e9fc38d33/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:17:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0353ec8c-5d1c-4283-aaaa-2fd1fad8ab57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:17:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0353ec8c-5d1c-4283-aaaa-2fd1fad8ab57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:17:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81de993a-e408-4800-98d4-1bb282ffeccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:17:04 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Volume 8986f984-24d9-491c-834c-89dcfd9fd0ff: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8986f984-24d9-491c-834c-89dcfd9fd0ff', 'volume_size': 1, 'image_id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02c779626a284994918db1738b55fe79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'created_at': datetime.datetime(2026, 11, 3, 7, 8, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 8, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9eb5e936-be4c-46be-8de8-899e9fc38d33/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 08:17:04 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Trying to clone 8986f984-24d9-491c-834c-89dcfd9fd0ff from image 9eb5e936-be4c-46be-8de8-899e9fc38d33 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}]). {{(pid=86801) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 08:17:04 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Nov 03 08:17:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.390s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:17:04 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:17:04 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager._thread_info {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:17:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread count: 8 {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 08:17:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread info: [<_MainThread(MainThread, started 139707544170624)>, , , , , , , ] {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 08:17:04 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_xbps5snodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 08:17:04 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Image download 20.69 MB at 20.69 MB/s Nov 03 08:17:05 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd6a77a-fc89-4434-ad81-132f643e8c84]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:17:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_xbps5snodevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:17:05 devstack sudo[91223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_xbps5snodevstack@QuobyteHD Nov 03 08:17:05 devstack sudo[91223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:17:05 devstack sudo[91223]: pam_unix(sudo:session): session closed for user root Nov 03 08:17:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_xbps5snodevstack@QuobyteHD" returned: 0 in 0.528s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:17:05 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Temporary image 9eb5e936-be4c-46be-8de8-899e9fc38d33 is fetched for user 5c26bbe18fa44999abaf63d74d22ef26. {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 08:17:05 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[9891c9cc-f2ff-4cdf-bd7e-1e4b2dacafcb]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:17:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_xbps5snodevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:17:05 devstack sudo[91230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_xbps5snodevstack@QuobyteHD Nov 03 08:17:05 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:17:06 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root Nov 03 08:17:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_xbps5snodevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:17:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:17:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:17:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-227121953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8986f984-24d9-491c-834c-89dcfd9fd0ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c4b94442a84a1eb7c1695724c98b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:17:03Z,use_quota=True,user_id='5c26bbe18fa44999abaf63d74d22ef26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:17:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Creating volume 8986f984-24d9-491c-834c-89dcfd9fd0ff {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:17:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:17:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:17:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:17:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:17:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:17:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:17:06 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:17:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8986f984-24d9-491c-834c-89dcfd9fd0ff 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:17:06 devstack sudo[91236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8986f984-24d9-491c-834c-89dcfd9fd0ff 1073741824 Nov 03 08:17:06 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:17:06 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root Nov 03 08:17:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8986f984-24d9-491c-834c-89dcfd9fd0ff 1073741824" returned: 0 in 0.536s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:17:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8986f984-24d9-491c-834c-89dcfd9fd0ff {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:17:06 devstack sudo[91243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8986f984-24d9-491c-834c-89dcfd9fd0ff Nov 03 08:17:06 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:17:06 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root Nov 03 08:17:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8986f984-24d9-491c-834c-89dcfd9fd0ff" returned: 0 in 0.303s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:17:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:17:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:17:06 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Attempting download of 9eb5e936-be4c-46be-8de8-899e9fc38d33 ((None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}])) to volume 8986f984-24d9-491c-834c-89dcfd9fd0ff. {{(pid=86801) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 08:17:07 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce14d642-9131-4b1d-8b24-73e375eacc91]: (4, 'raw') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:17:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_uviq664q {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:17:07 devstack sudo[91247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_uviq664q Nov 03 08:17:07 devstack sudo[91247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:17:07 devstack sudo[91247]: pam_unix(sudo:session): session closed for user root Nov 03 08:17:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_uviq664q" returned: 0 in 0.526s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:17:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_uviq664q {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:17:07 devstack sudo[91264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_uviq664q Nov 03 08:17:07 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:17:08 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root Nov 03 08:17:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_uviq664q" returned: 1 in 0.808s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:17:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_uviq664q' failed. Not Retrying. {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 08:17:08 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7154e1-104b-4c5b-88df-48c3a9ac5cce]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:17:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_xbps5snodevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:17:08 devstack sudo[91310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_xbps5snodevstack@QuobyteHD Nov 03 08:17:08 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:17:08 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root Nov 03 08:17:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_xbps5snodevstack@QuobyteHD" returned: 0 in 0.544s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:17:08 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] 9eb5e936-be4c-46be-8de8-899e9fc38d33 was qcow2, converting to qcow2 {{(pid=86801) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 08:17:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_xbps5snodevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8986f984-24d9-491c-834c-89dcfd9fd0ff {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:17:09 devstack sudo[91326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_xbps5snodevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8986f984-24d9-491c-834c-89dcfd9fd0ff Nov 03 08:17:09 devstack sudo[91326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:17:11 devstack sudo[91326]: pam_unix(sudo:session): session closed for user root Nov 03 08:17:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_xbps5snodevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8986f984-24d9-491c-834c-89dcfd9fd0ff" returned: 0 in 2.580s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:17:11 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_xbps5snodevstack@QuobyteHD, size 112.00 MB, duration 2.58 sec, destination /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8986f984-24d9-491c-834c-89dcfd9fd0ff {{(pid=86801) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 08:17:11 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Converted 112.00 MB image at 43.38 MB/s Nov 03 08:17:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8986f984-24d9-491c-834c-89dcfd9fd0ff 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:17:11 devstack sudo[91341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8986f984-24d9-491c-834c-89dcfd9fd0ff 1G Nov 03 08:17:11 devstack sudo[91341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:17:11 devstack sudo[91341]: pam_unix(sudo:session): session closed for user root Nov 03 08:17:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8986f984-24d9-491c-834c-89dcfd9fd0ff 1G" returned: 0 in 0.442s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:17:11 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Downloaded image 9eb5e936-be4c-46be-8de8-899e9fc38d33 ((None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}])) to volume 8986f984-24d9-491c-834c-89dcfd9fd0ff successfully. {{(pid=86801) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 08:17:12 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Temporary image 9eb5e936-be4c-46be-8de8-899e9fc38d33 for user 5c26bbe18fa44999abaf63d74d22ef26 is deleted. {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 08:17:12 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Marking volume 8986f984-24d9-491c-834c-89dcfd9fd0ff as bootable. {{(pid=86801) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 08:17:12 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Copying metadata from image 9eb5e936-be4c-46be-8de8-899e9fc38d33 to 8986f984-24d9-491c-834c-89dcfd9fd0ff. {{(pid=86801) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 08:17:12 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Creating volume glance metadata for volume 8986f984-24d9-491c-834c-89dcfd9fd0ff backed by image 9eb5e936-be4c-46be-8de8-899e9fc38d33 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86801) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 08:17:12 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81de993a-e408-4800-98d4-1bb282ffeccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8986f984-24d9-491c-834c-89dcfd9fd0ff', 'volume_size': 1, 'image_id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02c779626a284994918db1738b55fe79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'created_at': datetime.datetime(2026, 11, 3, 7, 8, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 8, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9eb5e936-be4c-46be-8de8-899e9fc38d33/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:17:12 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d197532b-02b1-4894-a0bf-37e1b89bfaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:17:12 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Volume volume-8986f984-24d9-491c-834c-89dcfd9fd0ff (8986f984-24d9-491c-834c-89dcfd9fd0ff): created successfully Nov 03 08:17:12 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d197532b-02b1-4894-a0bf-37e1b89bfaa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:17:12 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Flow 'volume_create_manager' (d0e0c21f-5974-4ca8-93b6-6df9461dd946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:17:12 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-eab51a7e-b6a5-4649-b9c8-c86fb5e49919 tempest-ServerActionsTestOtherA-191550997 None] Created volume successfully. Nov 03 08:17:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-e8ef9f03-502a-4b19-86af-f7ad28e2c607 req-c07ad2df-062a-4162-97ec-6c4c54d6d30e tempest-ServerActionsTestOtherA-191550997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:17:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-e8ef9f03-502a-4b19-86af-f7ad28e2c607 req-c07ad2df-062a-4162-97ec-6c4c54d6d30e tempest-ServerActionsTestOtherA-191550997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:17:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-e8ef9f03-502a-4b19-86af-f7ad28e2c607 req-c07ad2df-062a-4162-97ec-6c4c54d6d30e tempest-ServerActionsTestOtherA-191550997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:17:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-e8ef9f03-502a-4b19-86af-f7ad28e2c607 req-c07ad2df-062a-4162-97ec-6c4c54d6d30e tempest-ServerActionsTestOtherA-191550997 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f', 'name': 'volume-8986f984-24d9-491c-834c-89dcfd9fd0ff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3597461f-b9a4-49a0-8bb1-ae97d5378cc1', 'enforce_multipath': True} {{(pid=86801) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 08:17:17 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-e8ef9f03-502a-4b19-86af-f7ad28e2c607 req-c07ad2df-062a-4162-97ec-6c4c54d6d30e tempest-ServerActionsTestOtherA-191550997 None] attachment_update completed successfully. Nov 03 08:17:27 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=17,cinder:UPDATE=9,cinder:INSERT=7 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:17:27 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:UPDATE=3,cinder:SELECT=15,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:17:28 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:17:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Flow 'volume_create_manager' (11db30b1-5c5e-40e1-a358-d1d67e29fb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:17:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea75706-0ecf-4e13-8d1d-e27628c23a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:17:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea75706-0ecf-4e13-8d1d-e27628c23a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1440831986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=868d933e-7fd9-476c-88a9-2605a360928d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='718278c7baa4476aa5dd6fec2e88b48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:17:28Z,use_quota=True,user_id='621925c3a2424a4586014cfac97875a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:17:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf6f3cf-1ac9-4bf2-bf9d-d8196706eb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:17:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf6f3cf-1ac9-4bf2-bf9d-d8196706eb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:17:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8545fcb-19bc-4cd0-a9b2-873d8256c01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:17:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8545fcb-19bc-4cd0-a9b2-873d8256c01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '868d933e-7fd9-476c-88a9-2605a360928d', 'volume_name': 'volume-868d933e-7fd9-476c-88a9-2605a360928d', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:17:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e028e53-a482-4693-981e-3cbd86c93b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:17:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e028e53-a482-4693-981e-3cbd86c93b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:17:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec655d4b-f9c6-40f8-8d15-b8e85a355534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:17:28 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Volume 868d933e-7fd9-476c-88a9-2605a360928d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-868d933e-7fd9-476c-88a9-2605a360928d', 'volume_size': 1} Nov 03 08:17:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:17:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:17:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1440831986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=868d933e-7fd9-476c-88a9-2605a360928d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='718278c7baa4476aa5dd6fec2e88b48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:17:28Z,use_quota=True,user_id='621925c3a2424a4586014cfac97875a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:17:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Creating volume 868d933e-7fd9-476c-88a9-2605a360928d {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:17:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:17:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:17:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:17:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:17:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:17:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:17:28 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:17:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-868d933e-7fd9-476c-88a9-2605a360928d 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:17:28 devstack sudo[91593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-868d933e-7fd9-476c-88a9-2605a360928d 1073741824 Nov 03 08:17:28 devstack sudo[91593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:17:28 devstack sudo[91593]: pam_unix(sudo:session): session closed for user root Nov 03 08:17:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-868d933e-7fd9-476c-88a9-2605a360928d 1073741824" returned: 0 in 0.719s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:17:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-868d933e-7fd9-476c-88a9-2605a360928d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:17:29 devstack sudo[91598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-868d933e-7fd9-476c-88a9-2605a360928d Nov 03 08:17:29 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:17:29 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root Nov 03 08:17:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-868d933e-7fd9-476c-88a9-2605a360928d" returned: 0 in 0.435s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:17:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:17:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:17:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec655d4b-f9c6-40f8-8d15-b8e85a355534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-868d933e-7fd9-476c-88a9-2605a360928d', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:17:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da836195-e073-41d2-9568-e802bc6cdb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:17:29 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Volume volume-868d933e-7fd9-476c-88a9-2605a360928d (868d933e-7fd9-476c-88a9-2605a360928d): created successfully Nov 03 08:17:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da836195-e073-41d2-9568-e802bc6cdb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:17:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Flow 'volume_create_manager' (11db30b1-5c5e-40e1-a358-d1d67e29fb1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:17:29 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-5dccde94-0550-4598-8623-0c591eeba277 tempest-ServersNegativeTestJSON-1342642977 None] Created volume successfully. Nov 03 08:17:33 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:17:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Flow 'volume_create_manager' (141065eb-93bd-4fa2-86be-d6db19439020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:17:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f99354-52ab-45b1-a029-24602931732f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:17:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f99354-52ab-45b1-a029-24602931732f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-613560342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feb23df4-a5a1-4d90-97f3-cb8fd98c58b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='718278c7baa4476aa5dd6fec2e88b48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:17:33Z,use_quota=True,user_id='621925c3a2424a4586014cfac97875a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:17:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcaa1a7d-4ec6-4ddc-aea1-7f3c6eb8f0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:17:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcaa1a7d-4ec6-4ddc-aea1-7f3c6eb8f0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:17:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c6ef37f-07c8-442c-8423-d38008ec2039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:17:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c6ef37f-07c8-442c-8423-d38008ec2039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feb23df4-a5a1-4d90-97f3-cb8fd98c58b1', 'volume_name': 'volume-feb23df4-a5a1-4d90-97f3-cb8fd98c58b1', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:17:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d7ac9fa-4820-442a-ac37-793de6ffcb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:17:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d7ac9fa-4820-442a-ac37-793de6ffcb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:17:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61af914e-b448-4be4-bb40-314f786c2d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:17:33 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Volume feb23df4-a5a1-4d90-97f3-cb8fd98c58b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feb23df4-a5a1-4d90-97f3-cb8fd98c58b1', 'volume_size': 1} Nov 03 08:17:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:17:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:17:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-613560342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feb23df4-a5a1-4d90-97f3-cb8fd98c58b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='718278c7baa4476aa5dd6fec2e88b48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:17:33Z,use_quota=True,user_id='621925c3a2424a4586014cfac97875a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:17:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Creating volume feb23df4-a5a1-4d90-97f3-cb8fd98c58b1 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:17:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:17:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:17:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:17:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:17:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:17:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:17:33 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:17:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feb23df4-a5a1-4d90-97f3-cb8fd98c58b1 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:17:33 devstack sudo[91611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feb23df4-a5a1-4d90-97f3-cb8fd98c58b1 1073741824 Nov 03 08:17:33 devstack sudo[91611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:17:34 devstack sudo[91611]: pam_unix(sudo:session): session closed for user root Nov 03 08:17:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feb23df4-a5a1-4d90-97f3-cb8fd98c58b1 1073741824" returned: 0 in 0.852s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:17:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feb23df4-a5a1-4d90-97f3-cb8fd98c58b1 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:17:34 devstack sudo[91617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feb23df4-a5a1-4d90-97f3-cb8fd98c58b1 Nov 03 08:17:34 devstack sudo[91617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:17:34 devstack sudo[91617]: pam_unix(sudo:session): session closed for user root Nov 03 08:17:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feb23df4-a5a1-4d90-97f3-cb8fd98c58b1" returned: 0 in 0.427s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:17:34 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:17:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:17:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61af914e-b448-4be4-bb40-314f786c2d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feb23df4-a5a1-4d90-97f3-cb8fd98c58b1', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:17:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b099013-65ab-40d0-8765-619c6115f036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:17:35 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Volume volume-feb23df4-a5a1-4d90-97f3-cb8fd98c58b1 (feb23df4-a5a1-4d90-97f3-cb8fd98c58b1): created successfully Nov 03 08:17:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b099013-65ab-40d0-8765-619c6115f036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:17:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Flow 'volume_create_manager' (141065eb-93bd-4fa2-86be-d6db19439020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:17:35 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-368bfb34-365c-47ec-8140-dd37342394ec tempest-ServersNegativeTestJSON-1342642977 None] Created volume successfully. Nov 03 08:17:35 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-33228561-9642-4cea-9dc5-52b5830b4ee0 req-bccf479b-2fbe-496b-a910-c360d0a6863e tempest-AttachVolumeNegativeTest-1934443952 None] Terminate volume connection completed successfully. Nov 03 08:17:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-33228561-9642-4cea-9dc5-52b5830b4ee0 req-bccf479b-2fbe-496b-a910-c360d0a6863e tempest-AttachVolumeNegativeTest-1934443952 None] Deleting attachment 8228321e-2ea2-47a5-8765-b4923bd3326b. {{(pid=86801) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 08:17:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-adf79d68-e72b-462b-a63d-cd6fba00fe8c tempest-ServersNegativeTestJSON-1342642977 None] Acquiring lock "cinder-feb23df4-a5a1-4d90-97f3-cb8fd98c58b1-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:17:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-adf79d68-e72b-462b-a63d-cd6fba00fe8c tempest-ServersNegativeTestJSON-1342642977 None] Lock "cinder-feb23df4-a5a1-4d90-97f3-cb8fd98c58b1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:17:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-adf79d68-e72b-462b-a63d-cd6fba00fe8c tempest-ServersNegativeTestJSON-1342642977 None] Acquiring lock "cinder-quobyte-feb23df4-a5a1-4d90-97f3-cb8fd98c58b1" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:17:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-adf79d68-e72b-462b-a63d-cd6fba00fe8c tempest-ServersNegativeTestJSON-1342642977 None] Lock "cinder-quobyte-feb23df4-a5a1-4d90-97f3-cb8fd98c58b1" acquired by "delete_volume" :: waited 0.031s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:17:36 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51e5863-f87f-4182-ab67-9e010e75f63a]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:17:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-adf79d68-e72b-462b-a63d-cd6fba00fe8c tempest-ServersNegativeTestJSON-1342642977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feb23df4-a5a1-4d90-97f3-cb8fd98c58b1 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:17:36 devstack sudo[91626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feb23df4-a5a1-4d90-97f3-cb8fd98c58b1 Nov 03 08:17:36 devstack sudo[91626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:17:37 devstack sudo[91626]: pam_unix(sudo:session): session closed for user root Nov 03 08:17:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-adf79d68-e72b-462b-a63d-cd6fba00fe8c tempest-ServersNegativeTestJSON-1342642977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feb23df4-a5a1-4d90-97f3-cb8fd98c58b1" returned: 0 in 0.618s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:17:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-adf79d68-e72b-462b-a63d-cd6fba00fe8c tempest-ServersNegativeTestJSON-1342642977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feb23df4-a5a1-4d90-97f3-cb8fd98c58b1 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:17:37 devstack sudo[91661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feb23df4-a5a1-4d90-97f3-cb8fd98c58b1 Nov 03 08:17:37 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:17:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-adf79d68-e72b-462b-a63d-cd6fba00fe8c tempest-ServersNegativeTestJSON-1342642977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feb23df4-a5a1-4d90-97f3-cb8fd98c58b1" returned: 0 in 0.461s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:17:37 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root Nov 03 08:17:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-adf79d68-e72b-462b-a63d-cd6fba00fe8c tempest-ServersNegativeTestJSON-1342642977 None] Lock "cinder-quobyte-feb23df4-a5a1-4d90-97f3-cb8fd98c58b1" released by "delete_volume" :: held 1.169s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:17:37 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-bace926f-649f-49da-a9a6-1304ddf00b4d req-2411411d-332a-49c6-9537-a13eb4626416 tempest-ServerActionsTestOtherA-191550997 None] Terminate volume connection completed successfully. Nov 03 08:17:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-bace926f-649f-49da-a9a6-1304ddf00b4d req-2411411d-332a-49c6-9537-a13eb4626416 tempest-ServerActionsTestOtherA-191550997 None] Deleting attachment 3597461f-b9a4-49a0-8bb1-ae97d5378cc1. {{(pid=86801) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 08:17:37 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-adf79d68-e72b-462b-a63d-cd6fba00fe8c tempest-ServersNegativeTestJSON-1342642977 None] Created reservations ['81d291a2-f577-4b27-9ca7-4628a645506b', 'f151bfda-042f-402e-940e-38e71a145f3d', '5f5e9135-56bd-4fc7-af22-ed6b379541b9', '533b76e8-9eb8-4df3-829a-4dfa9b67eed3'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:17:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-adf79d68-e72b-462b-a63d-cd6fba00fe8c tempest-ServersNegativeTestJSON-1342642977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:17:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-adf79d68-e72b-462b-a63d-cd6fba00fe8c tempest-ServersNegativeTestJSON-1342642977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:17:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-adf79d68-e72b-462b-a63d-cd6fba00fe8c tempest-ServersNegativeTestJSON-1342642977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:17:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-adf79d68-e72b-462b-a63d-cd6fba00fe8c tempest-ServersNegativeTestJSON-1342642977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:17:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-adf79d68-e72b-462b-a63d-cd6fba00fe8c tempest-ServersNegativeTestJSON-1342642977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:17:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-adf79d68-e72b-462b-a63d-cd6fba00fe8c tempest-ServersNegativeTestJSON-1342642977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:17:37 devstack sudo[91674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:17:37 devstack sudo[91674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:17:38 devstack sudo[91674]: pam_unix(sudo:session): session closed for user root Nov 03 08:17:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-adf79d68-e72b-462b-a63d-cd6fba00fe8c tempest-ServersNegativeTestJSON-1342642977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.288s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:17:38 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-adf79d68-e72b-462b-a63d-cd6fba00fe8c tempest-ServersNegativeTestJSON-1342642977 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:17:38 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-adf79d68-e72b-462b-a63d-cd6fba00fe8c tempest-ServersNegativeTestJSON-1342642977 None] Deleted volume successfully. Nov 03 08:17:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-adf79d68-e72b-462b-a63d-cd6fba00fe8c tempest-ServersNegativeTestJSON-1342642977 None] Lock "cinder-feb23df4-a5a1-4d90-97f3-cb8fd98c58b1-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:17:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1aee1b2d-8c70-4633-a709-79d42d838b00 tempest-ServersNegativeTestJSON-1342642977 None] Acquiring lock "cinder-868d933e-7fd9-476c-88a9-2605a360928d-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:17:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1aee1b2d-8c70-4633-a709-79d42d838b00 tempest-ServersNegativeTestJSON-1342642977 None] Lock "cinder-868d933e-7fd9-476c-88a9-2605a360928d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:17:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1aee1b2d-8c70-4633-a709-79d42d838b00 tempest-ServersNegativeTestJSON-1342642977 None] Acquiring lock "cinder-quobyte-868d933e-7fd9-476c-88a9-2605a360928d" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:17:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1aee1b2d-8c70-4633-a709-79d42d838b00 tempest-ServersNegativeTestJSON-1342642977 None] Lock "cinder-quobyte-868d933e-7fd9-476c-88a9-2605a360928d" acquired by "delete_volume" :: waited 0.035s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:17:38 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd01b628-6d04-468b-9360-502ac879eda8]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:17:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1aee1b2d-8c70-4633-a709-79d42d838b00 tempest-ServersNegativeTestJSON-1342642977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-868d933e-7fd9-476c-88a9-2605a360928d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:17:38 devstack sudo[91680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-868d933e-7fd9-476c-88a9-2605a360928d Nov 03 08:17:38 devstack sudo[91680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:17:39 devstack sudo[91680]: pam_unix(sudo:session): session closed for user root Nov 03 08:17:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1aee1b2d-8c70-4633-a709-79d42d838b00 tempest-ServersNegativeTestJSON-1342642977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-868d933e-7fd9-476c-88a9-2605a360928d" returned: 0 in 0.523s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:17:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1aee1b2d-8c70-4633-a709-79d42d838b00 tempest-ServersNegativeTestJSON-1342642977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-868d933e-7fd9-476c-88a9-2605a360928d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:17:39 devstack sudo[91687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-868d933e-7fd9-476c-88a9-2605a360928d Nov 03 08:17:39 devstack sudo[91687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:17:39 devstack sudo[91687]: pam_unix(sudo:session): session closed for user root Nov 03 08:17:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1aee1b2d-8c70-4633-a709-79d42d838b00 tempest-ServersNegativeTestJSON-1342642977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-868d933e-7fd9-476c-88a9-2605a360928d" returned: 0 in 0.302s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:17:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1aee1b2d-8c70-4633-a709-79d42d838b00 tempest-ServersNegativeTestJSON-1342642977 None] Lock "cinder-quobyte-868d933e-7fd9-476c-88a9-2605a360928d" released by "delete_volume" :: held 0.913s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:17:39 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-1aee1b2d-8c70-4633-a709-79d42d838b00 tempest-ServersNegativeTestJSON-1342642977 None] Created reservations ['98cbcdfd-e3b0-455b-9c4c-4a2a2456c414', '5ecf2db5-6c37-481a-be0d-7dbad7d925ec', '3766fb9d-b0a4-48cc-b996-34a2dbba325c', '3a38aba3-727b-4671-a940-0b9f417b0a38'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:17:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1aee1b2d-8c70-4633-a709-79d42d838b00 tempest-ServersNegativeTestJSON-1342642977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:17:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1aee1b2d-8c70-4633-a709-79d42d838b00 tempest-ServersNegativeTestJSON-1342642977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:17:39 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1aee1b2d-8c70-4633-a709-79d42d838b00 tempest-ServersNegativeTestJSON-1342642977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:17:39 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1aee1b2d-8c70-4633-a709-79d42d838b00 tempest-ServersNegativeTestJSON-1342642977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:17:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1aee1b2d-8c70-4633-a709-79d42d838b00 tempest-ServersNegativeTestJSON-1342642977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:17:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1aee1b2d-8c70-4633-a709-79d42d838b00 tempest-ServersNegativeTestJSON-1342642977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:17:39 devstack sudo[91690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:17:39 devstack sudo[91690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:17:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-bace926f-649f-49da-a9a6-1304ddf00b4d req-98e0eec6-3d93-4f3a-935f-80cb2e70acd2 tempest-ServerActionsTestOtherA-191550997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:17:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-bace926f-649f-49da-a9a6-1304ddf00b4d req-98e0eec6-3d93-4f3a-935f-80cb2e70acd2 tempest-ServerActionsTestOtherA-191550997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:17:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-bace926f-649f-49da-a9a6-1304ddf00b4d req-98e0eec6-3d93-4f3a-935f-80cb2e70acd2 tempest-ServerActionsTestOtherA-191550997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:17:40 devstack sudo[91690]: pam_unix(sudo:session): session closed for user root Nov 03 08:17:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1aee1b2d-8c70-4633-a709-79d42d838b00 tempest-ServersNegativeTestJSON-1342642977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.265s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:17:40 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-1aee1b2d-8c70-4633-a709-79d42d838b00 tempest-ServersNegativeTestJSON-1342642977 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:17:40 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-1aee1b2d-8c70-4633-a709-79d42d838b00 tempest-ServersNegativeTestJSON-1342642977 None] Deleted volume successfully. Nov 03 08:17:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1aee1b2d-8c70-4633-a709-79d42d838b00 tempest-ServersNegativeTestJSON-1342642977 None] Lock "cinder-868d933e-7fd9-476c-88a9-2605a360928d-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:17:40 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-bace926f-649f-49da-a9a6-1304ddf00b4d req-98e0eec6-3d93-4f3a-935f-80cb2e70acd2 tempest-ServerActionsTestOtherA-191550997 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f', 'name': 'volume-8986f984-24d9-491c-834c-89dcfd9fd0ff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4a40fa5c-00c3-40a0-ae72-25c154656aed', 'enforce_multipath': True} {{(pid=86801) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 08:17:40 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-bace926f-649f-49da-a9a6-1304ddf00b4d req-98e0eec6-3d93-4f3a-935f-80cb2e70acd2 tempest-ServerActionsTestOtherA-191550997 None] attachment_update completed successfully. Nov 03 08:17:50 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:UPDATE=21,cinder:SELECT=21,cinder:INSERT=6,cinder:DELETE=4 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:17:50 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=24,cinder:UPDATE=26,cinder:INSERT=4 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:17:56 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:17:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Flow 'volume_create_manager' (f950ab7c-802d-4701-97a1-a7677671759b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:17:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c0ee472-87af-4b4e-ae6f-cc7b4d73122a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:17:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c0ee472-87af-4b4e-ae6f-cc7b4d73122a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1095583561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92253663-bef1-494b-8b0e-d0caeda66033,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5cf7eb79436442b29f24a59366cf1ce3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:17:56Z,use_quota=True,user_id='bf50415179be4a209ad038d63481e199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:17:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0a7985f-068e-4c26-a5d9-cc201df060a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:17:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0a7985f-068e-4c26-a5d9-cc201df060a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:17:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a25d66f-3b39-4547-b6f2-27156749cfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:17:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a25d66f-3b39-4547-b6f2-27156749cfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92253663-bef1-494b-8b0e-d0caeda66033', 'volume_name': 'volume-92253663-bef1-494b-8b0e-d0caeda66033', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:17:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8016e6d-9dab-46f9-8395-93a31f6c1ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:17:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8016e6d-9dab-46f9-8395-93a31f6c1ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:17:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9dfd6aa-c3a0-4de7-b7b0-67098b20ea6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:17:56 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Volume 92253663-bef1-494b-8b0e-d0caeda66033: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92253663-bef1-494b-8b0e-d0caeda66033', 'volume_size': 1} Nov 03 08:17:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:17:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:17:56 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1095583561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92253663-bef1-494b-8b0e-d0caeda66033,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5cf7eb79436442b29f24a59366cf1ce3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:17:56Z,use_quota=True,user_id='bf50415179be4a209ad038d63481e199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:17:56 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Creating volume 92253663-bef1-494b-8b0e-d0caeda66033 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:17:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:17:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:17:56 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:17:56 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:17:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:17:56 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:17:56 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:17:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-92253663-bef1-494b-8b0e-d0caeda66033 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:17:56 devstack sudo[92286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-92253663-bef1-494b-8b0e-d0caeda66033 1073741824 Nov 03 08:17:56 devstack sudo[92286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:17:56 devstack sudo[92286]: pam_unix(sudo:session): session closed for user root Nov 03 08:17:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-92253663-bef1-494b-8b0e-d0caeda66033 1073741824" returned: 0 in 0.519s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:17:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-92253663-bef1-494b-8b0e-d0caeda66033 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:17:56 devstack sudo[92293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-92253663-bef1-494b-8b0e-d0caeda66033 Nov 03 08:17:56 devstack sudo[92293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:17:56 devstack sudo[92293]: pam_unix(sudo:session): session closed for user root Nov 03 08:17:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-92253663-bef1-494b-8b0e-d0caeda66033" returned: 0 in 0.287s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:17:56 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:17:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:17:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9dfd6aa-c3a0-4de7-b7b0-67098b20ea6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92253663-bef1-494b-8b0e-d0caeda66033', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:17:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8105f58e-ae1e-4dcc-af07-cedc86e3b054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:17:57 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Volume volume-92253663-bef1-494b-8b0e-d0caeda66033 (92253663-bef1-494b-8b0e-d0caeda66033): created successfully Nov 03 08:17:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8105f58e-ae1e-4dcc-af07-cedc86e3b054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:17:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Flow 'volume_create_manager' (f950ab7c-802d-4701-97a1-a7677671759b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:17:57 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-9b910b1b-ac77-4d79-9c9b-c84ce51a5766 req-f32fcc50-a600-4fc5-b2c3-4cb7f21a0901 tempest-VolumesGetTestJSON-199268820 None] Created volume successfully. Nov 03 08:17:58 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-1785170a-7557-4087-a195-4955a23ae6c2 req-e33489c3-1c4d-4f71-8cda-9d1443b9ec32 tempest-VolumesGetTestJSON-199268820 None] Acquiring lock "cinder-92253663-bef1-494b-8b0e-d0caeda66033-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:17:58 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-1785170a-7557-4087-a195-4955a23ae6c2 req-e33489c3-1c4d-4f71-8cda-9d1443b9ec32 tempest-VolumesGetTestJSON-199268820 None] Lock "cinder-92253663-bef1-494b-8b0e-d0caeda66033-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:17:58 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-1785170a-7557-4087-a195-4955a23ae6c2 req-e33489c3-1c4d-4f71-8cda-9d1443b9ec32 tempest-VolumesGetTestJSON-199268820 None] Acquiring lock "cinder-quobyte-92253663-bef1-494b-8b0e-d0caeda66033" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:17:58 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-1785170a-7557-4087-a195-4955a23ae6c2 req-e33489c3-1c4d-4f71-8cda-9d1443b9ec32 tempest-VolumesGetTestJSON-199268820 None] Lock "cinder-quobyte-92253663-bef1-494b-8b0e-d0caeda66033" acquired by "delete_volume" :: waited 0.030s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:17:58 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[d804f924-01ad-4e28-aa39-bca50ebc19df]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:17:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-1785170a-7557-4087-a195-4955a23ae6c2 req-e33489c3-1c4d-4f71-8cda-9d1443b9ec32 tempest-VolumesGetTestJSON-199268820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-92253663-bef1-494b-8b0e-d0caeda66033 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:17:58 devstack sudo[92298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-92253663-bef1-494b-8b0e-d0caeda66033 Nov 03 08:17:58 devstack sudo[92298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:17:59 devstack sudo[92298]: pam_unix(sudo:session): session closed for user root Nov 03 08:17:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-1785170a-7557-4087-a195-4955a23ae6c2 req-e33489c3-1c4d-4f71-8cda-9d1443b9ec32 tempest-VolumesGetTestJSON-199268820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-92253663-bef1-494b-8b0e-d0caeda66033" returned: 0 in 0.494s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:17:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-1785170a-7557-4087-a195-4955a23ae6c2 req-e33489c3-1c4d-4f71-8cda-9d1443b9ec32 tempest-VolumesGetTestJSON-199268820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-92253663-bef1-494b-8b0e-d0caeda66033 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:17:59 devstack sudo[92304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-92253663-bef1-494b-8b0e-d0caeda66033 Nov 03 08:17:59 devstack sudo[92304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:17:59 devstack sudo[92304]: pam_unix(sudo:session): session closed for user root Nov 03 08:17:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-1785170a-7557-4087-a195-4955a23ae6c2 req-e33489c3-1c4d-4f71-8cda-9d1443b9ec32 tempest-VolumesGetTestJSON-199268820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-92253663-bef1-494b-8b0e-d0caeda66033" returned: 0 in 0.286s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:17:59 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-1785170a-7557-4087-a195-4955a23ae6c2 req-e33489c3-1c4d-4f71-8cda-9d1443b9ec32 tempest-VolumesGetTestJSON-199268820 None] Lock "cinder-quobyte-92253663-bef1-494b-8b0e-d0caeda66033" released by "delete_volume" :: held 0.847s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:17:59 devstack cinder-volume[86801]: DEBUG cinder.quota [req-1785170a-7557-4087-a195-4955a23ae6c2 req-e33489c3-1c4d-4f71-8cda-9d1443b9ec32 tempest-VolumesGetTestJSON-199268820 None] Created reservations ['8cb4ee81-659e-4e0e-8c91-d519659f52e4', 'b3c89dda-8521-43f9-9135-3b493f4c89d1', '40ff63ba-9ae0-4aa1-8b48-9a716b018bee', '1ea30650-018c-4d75-aa46-69d0a8eacdf8'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:17:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-1785170a-7557-4087-a195-4955a23ae6c2 req-e33489c3-1c4d-4f71-8cda-9d1443b9ec32 tempest-VolumesGetTestJSON-199268820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:17:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-1785170a-7557-4087-a195-4955a23ae6c2 req-e33489c3-1c4d-4f71-8cda-9d1443b9ec32 tempest-VolumesGetTestJSON-199268820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:17:59 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [req-1785170a-7557-4087-a195-4955a23ae6c2 req-e33489c3-1c4d-4f71-8cda-9d1443b9ec32 tempest-VolumesGetTestJSON-199268820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:17:59 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [req-1785170a-7557-4087-a195-4955a23ae6c2 req-e33489c3-1c4d-4f71-8cda-9d1443b9ec32 tempest-VolumesGetTestJSON-199268820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:17:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-1785170a-7557-4087-a195-4955a23ae6c2 req-e33489c3-1c4d-4f71-8cda-9d1443b9ec32 tempest-VolumesGetTestJSON-199268820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:17:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-1785170a-7557-4087-a195-4955a23ae6c2 req-e33489c3-1c4d-4f71-8cda-9d1443b9ec32 tempest-VolumesGetTestJSON-199268820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:17:59 devstack sudo[92309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:17:59 devstack sudo[92309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:17:59 devstack sudo[92309]: pam_unix(sudo:session): session closed for user root Nov 03 08:17:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-1785170a-7557-4087-a195-4955a23ae6c2 req-e33489c3-1c4d-4f71-8cda-9d1443b9ec32 tempest-VolumesGetTestJSON-199268820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.284s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:17:59 devstack cinder-volume[86801]: DEBUG cinder.manager [req-1785170a-7557-4087-a195-4955a23ae6c2 req-e33489c3-1c4d-4f71-8cda-9d1443b9ec32 tempest-VolumesGetTestJSON-199268820 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:17:59 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-1785170a-7557-4087-a195-4955a23ae6c2 req-e33489c3-1c4d-4f71-8cda-9d1443b9ec32 tempest-VolumesGetTestJSON-199268820 None] Deleted volume successfully. Nov 03 08:17:59 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-1785170a-7557-4087-a195-4955a23ae6c2 req-e33489c3-1c4d-4f71-8cda-9d1443b9ec32 tempest-VolumesGetTestJSON-199268820 None] Lock "cinder-92253663-bef1-494b-8b0e-d0caeda66033-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:18:03 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:18:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:18:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:18:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:18:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:18:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:18:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:03 devstack sudo[92386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:18:03 devstack sudo[92386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:03 devstack sudo[92386]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.259s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:03 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:18:08 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-0ea964f6-1e7e-44e2-a8e0-5611ff7716de tempest-GroupSnapshotsTest-1985507406 None] Group tempest-GroupSnapshotsTest-Group-1401587364: creating Nov 03 08:18:08 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-0ea964f6-1e7e-44e2-a8e0-5611ff7716de tempest-GroupSnapshotsTest-1985507406 None] Group tempest-GroupSnapshotsTest-Group-1401587364: created successfully Nov 03 08:18:08 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-0ea964f6-1e7e-44e2-a8e0-5611ff7716de tempest-GroupSnapshotsTest-1985507406 None] Create group completed successfully. Nov 03 08:18:10 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:18:10 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Flow 'volume_create_manager' (90b44554-06c5-4ef2-a641-7bba3ae382ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:18:10 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d46e2d99-d10e-4455-bbec-8e230330374d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:18:10 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d46e2d99-d10e-4455-bbec-8e230330374d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1317772586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=32d24f9f-ca3f-415c-9c0b-b7ae172ae4b8,host='devstack@QuobyteHD#QuobyteHD',id=feea08c3-b2c3-4257-8e46-a758bcbd658f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c894a09b90e4399bc0f766c5373a795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:10Z,use_quota=True,user_id='a4cebff489254c328f5880b328bec86a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49fa9df2-6940-48b5-b82b-3949aaf2d227),volume_type_id=49fa9df2-6940-48b5-b82b-3949aaf2d227)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:18:10 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b30f33fc-9010-40e8-a3f2-d8d2b74cbd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:18:10 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b30f33fc-9010-40e8-a3f2-d8d2b74cbd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:18:10 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a730a36-aadf-47d0-b578-bb64b0a6fe72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:18:10 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a730a36-aadf-47d0-b578-bb64b0a6fe72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feea08c3-b2c3-4257-8e46-a758bcbd658f', 'volume_name': 'volume-feea08c3-b2c3-4257-8e46-a758bcbd658f', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:18:10 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7607ca2-0f4f-4232-ac26-35ec62c49cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:18:10 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7607ca2-0f4f-4232-ac26-35ec62c49cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:18:10 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7f3ce8-14c0-425f-a373-f92959261598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:18:10 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Volume feea08c3-b2c3-4257-8e46-a758bcbd658f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feea08c3-b2c3-4257-8e46-a758bcbd658f', 'volume_size': 1} Nov 03 08:18:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:18:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:18:10 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=32d24f9f-ca3f-415c-9c0b-b7ae172ae4b8,created_at=2026-11-03T07:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1317772586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=32d24f9f-ca3f-415c-9c0b-b7ae172ae4b8,host='devstack@QuobyteHD#QuobyteHD',id=feea08c3-b2c3-4257-8e46-a758bcbd658f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c894a09b90e4399bc0f766c5373a795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:10Z,use_quota=True,user_id='a4cebff489254c328f5880b328bec86a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49fa9df2-6940-48b5-b82b-3949aaf2d227),volume_type_id=49fa9df2-6940-48b5-b82b-3949aaf2d227)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:18:10 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Creating volume feea08c3-b2c3-4257-8e46-a758bcbd658f {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:18:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:18:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:18:10 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:18:10 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:18:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:18:10 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:18:10 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:18:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:10 devstack sudo[92458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f 1073741824 Nov 03 08:18:10 devstack sudo[92458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:10 devstack sudo[92458]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f 1073741824" returned: 0 in 0.552s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:10 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-3b7b86cf-5737-4d04-be35-32ad9fab3f87 req-22e1aabd-e9fc-4ffb-bfb0-59a4af5788c6 tempest-ServerActionsTestOtherA-191550997 None] Terminate volume connection completed successfully. Nov 03 08:18:10 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-3b7b86cf-5737-4d04-be35-32ad9fab3f87 req-22e1aabd-e9fc-4ffb-bfb0-59a4af5788c6 tempest-ServerActionsTestOtherA-191550997 None] Deleting attachment 4a40fa5c-00c3-40a0-ae72-25c154656aed. {{(pid=86801) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 08:18:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:10 devstack sudo[92467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f Nov 03 08:18:10 devstack sudo[92467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:11 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-3b7b86cf-5737-4d04-be35-32ad9fab3f87 req-39273adf-fb1f-42f2-82fc-6d2f6157e1e2 tempest-ServerActionsTestOtherA-191550997 None] Acquiring lock "cinder-8986f984-24d9-491c-834c-89dcfd9fd0ff-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:18:11 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-3b7b86cf-5737-4d04-be35-32ad9fab3f87 req-39273adf-fb1f-42f2-82fc-6d2f6157e1e2 tempest-ServerActionsTestOtherA-191550997 None] Lock "cinder-8986f984-24d9-491c-834c-89dcfd9fd0ff-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:18:11 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-3b7b86cf-5737-4d04-be35-32ad9fab3f87 req-39273adf-fb1f-42f2-82fc-6d2f6157e1e2 tempest-ServerActionsTestOtherA-191550997 None] Acquiring lock "cinder-quobyte-8986f984-24d9-491c-834c-89dcfd9fd0ff" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:18:11 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-3b7b86cf-5737-4d04-be35-32ad9fab3f87 req-39273adf-fb1f-42f2-82fc-6d2f6157e1e2 tempest-ServerActionsTestOtherA-191550997 None] Lock "cinder-quobyte-8986f984-24d9-491c-834c-89dcfd9fd0ff" acquired by "delete_volume" :: waited 0.018s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:18:11 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[275189b8-09df-4e01-8ca7-a55e9aaa6e83]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:18:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-3b7b86cf-5737-4d04-be35-32ad9fab3f87 req-39273adf-fb1f-42f2-82fc-6d2f6157e1e2 tempest-ServerActionsTestOtherA-191550997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8986f984-24d9-491c-834c-89dcfd9fd0ff {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:11 devstack sudo[92467]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f" returned: 0 in 0.279s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:11 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:18:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:18:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7f3ce8-14c0-425f-a373-f92959261598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feea08c3-b2c3-4257-8e46-a758bcbd658f', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:18:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f602cae-94af-4643-91b2-5b7e159fbc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:18:11 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Volume volume-feea08c3-b2c3-4257-8e46-a758bcbd658f (feea08c3-b2c3-4257-8e46-a758bcbd658f): created successfully Nov 03 08:18:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f602cae-94af-4643-91b2-5b7e159fbc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:18:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Flow 'volume_create_manager' (90b44554-06c5-4ef2-a641-7bba3ae382ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:18:11 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-26cfa2f0-1c2e-4b37-8e27-7d4a6d75f8b2 tempest-GroupSnapshotsTest-1985507406 None] Created volume successfully. Nov 03 08:18:11 devstack sudo[92470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8986f984-24d9-491c-834c-89dcfd9fd0ff Nov 03 08:18:11 devstack sudo[92470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:11 devstack sudo[92470]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-3b7b86cf-5737-4d04-be35-32ad9fab3f87 req-39273adf-fb1f-42f2-82fc-6d2f6157e1e2 tempest-ServerActionsTestOtherA-191550997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8986f984-24d9-491c-834c-89dcfd9fd0ff" returned: 0 in 0.425s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-3b7b86cf-5737-4d04-be35-32ad9fab3f87 req-39273adf-fb1f-42f2-82fc-6d2f6157e1e2 tempest-ServerActionsTestOtherA-191550997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8986f984-24d9-491c-834c-89dcfd9fd0ff {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:11 devstack sudo[92475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8986f984-24d9-491c-834c-89dcfd9fd0ff Nov 03 08:18:11 devstack sudo[92475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:11 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-0a02a5eb-9914-49d6-a2de-c57fb4a0e712 tempest-GroupSnapshotsTest-1985507406 None] GroupSnapshot abdec97b-f2e9-4f60-9255-4f8dde39ea4d: creating. Nov 03 08:18:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0a02a5eb-9914-49d6-a2de-c57fb4a0e712 tempest-GroupSnapshotsTest-1985507406 None] Group snapshot abdec97b-f2e9-4f60-9255-4f8dde39ea4d: creating. {{(pid=86801) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 08:18:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0a02a5eb-9914-49d6-a2de-c57fb4a0e712 tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:18:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0a02a5eb-9914-49d6-a2de-c57fb4a0e712 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:18:11 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-0a02a5eb-9914-49d6-a2de-c57fb4a0e712 tempest-GroupSnapshotsTest-1985507406 None] Creating offline snapshot dcaf9658-ef6b-4e02-936d-c65fac614dd0 of volume feea08c3-b2c3-4257-8e46-a758bcbd658f {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:18:11 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccddc26-2646-4588-81df-a7f088ef1e21]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:18:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0a02a5eb-9914-49d6-a2de-c57fb4a0e712 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:11 devstack sudo[92475]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-3b7b86cf-5737-4d04-be35-32ad9fab3f87 req-39273adf-fb1f-42f2-82fc-6d2f6157e1e2 tempest-ServerActionsTestOtherA-191550997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8986f984-24d9-491c-834c-89dcfd9fd0ff" returned: 0 in 0.323s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:11 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-3b7b86cf-5737-4d04-be35-32ad9fab3f87 req-39273adf-fb1f-42f2-82fc-6d2f6157e1e2 tempest-ServerActionsTestOtherA-191550997 None] Lock "cinder-quobyte-8986f984-24d9-491c-834c-89dcfd9fd0ff" released by "delete_volume" :: held 0.799s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:18:11 devstack sudo[92477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f Nov 03 08:18:11 devstack sudo[92477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:12 devstack cinder-volume[86801]: DEBUG cinder.quota [req-3b7b86cf-5737-4d04-be35-32ad9fab3f87 req-39273adf-fb1f-42f2-82fc-6d2f6157e1e2 tempest-ServerActionsTestOtherA-191550997 None] Created reservations ['22c8c1e5-e3cc-49d9-9eb9-869f22cb6be9', 'b0019814-5ef3-4a9c-803c-49ad7d84cf6e', '4e5e0ba5-8dbe-49d8-9f67-a00b5b9a6ff9', 'd32990cf-4a31-47cb-895a-0015209d30e6'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:18:12 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0d38080e-74a6-42a7-afe7-5559f50bf7eb tempest-ServerActionsTestOtherA-191550997 None] Acquiring lock "cinder-36f501da-f217-4cab-b6ed-7ec0492f45b6-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:18:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-3b7b86cf-5737-4d04-be35-32ad9fab3f87 req-39273adf-fb1f-42f2-82fc-6d2f6157e1e2 tempest-ServerActionsTestOtherA-191550997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:18:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-3b7b86cf-5737-4d04-be35-32ad9fab3f87 req-39273adf-fb1f-42f2-82fc-6d2f6157e1e2 tempest-ServerActionsTestOtherA-191550997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:18:12 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [req-3b7b86cf-5737-4d04-be35-32ad9fab3f87 req-39273adf-fb1f-42f2-82fc-6d2f6157e1e2 tempest-ServerActionsTestOtherA-191550997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:18:12 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [req-3b7b86cf-5737-4d04-be35-32ad9fab3f87 req-39273adf-fb1f-42f2-82fc-6d2f6157e1e2 tempest-ServerActionsTestOtherA-191550997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:18:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-3b7b86cf-5737-4d04-be35-32ad9fab3f87 req-39273adf-fb1f-42f2-82fc-6d2f6157e1e2 tempest-ServerActionsTestOtherA-191550997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:18:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-3b7b86cf-5737-4d04-be35-32ad9fab3f87 req-39273adf-fb1f-42f2-82fc-6d2f6157e1e2 tempest-ServerActionsTestOtherA-191550997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:12 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0d38080e-74a6-42a7-afe7-5559f50bf7eb tempest-ServerActionsTestOtherA-191550997 None] Lock "cinder-36f501da-f217-4cab-b6ed-7ec0492f45b6-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:18:12 devstack sudo[92480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:18:12 devstack sudo[92480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:12 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0d38080e-74a6-42a7-afe7-5559f50bf7eb tempest-ServerActionsTestOtherA-191550997 None] Acquiring lock "cinder-quobyte-36f501da-f217-4cab-b6ed-7ec0492f45b6" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:18:12 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0d38080e-74a6-42a7-afe7-5559f50bf7eb tempest-ServerActionsTestOtherA-191550997 None] Lock "cinder-quobyte-36f501da-f217-4cab-b6ed-7ec0492f45b6" acquired by "delete_volume" :: waited 0.017s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:18:12 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[73640ad9-b536-4383-9a3d-f5d31a71ccd2]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:18:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0d38080e-74a6-42a7-afe7-5559f50bf7eb tempest-ServerActionsTestOtherA-191550997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-36f501da-f217-4cab-b6ed-7ec0492f45b6 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:12 devstack sudo[92477]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0a02a5eb-9914-49d6-a2de-c57fb4a0e712 tempest-GroupSnapshotsTest-1985507406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f" returned: 0 in 0.453s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0a02a5eb-9914-49d6-a2de-c57fb4a0e712 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.dcaf9658-ef6b-4e02-936d-c65fac614dd0 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:12 devstack sudo[92487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.dcaf9658-ef6b-4e02-936d-c65fac614dd0 1G Nov 03 08:18:12 devstack sudo[92487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:12 devstack sudo[92484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-36f501da-f217-4cab-b6ed-7ec0492f45b6 Nov 03 08:18:12 devstack sudo[92484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:12 devstack sudo[92480]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-3b7b86cf-5737-4d04-be35-32ad9fab3f87 req-39273adf-fb1f-42f2-82fc-6d2f6157e1e2 tempest-ServerActionsTestOtherA-191550997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.309s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:12 devstack cinder-volume[86801]: DEBUG cinder.manager [req-3b7b86cf-5737-4d04-be35-32ad9fab3f87 req-39273adf-fb1f-42f2-82fc-6d2f6157e1e2 tempest-ServerActionsTestOtherA-191550997 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:18:12 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-3b7b86cf-5737-4d04-be35-32ad9fab3f87 req-39273adf-fb1f-42f2-82fc-6d2f6157e1e2 tempest-ServerActionsTestOtherA-191550997 None] Deleted volume successfully. Nov 03 08:18:12 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-3b7b86cf-5737-4d04-be35-32ad9fab3f87 req-39273adf-fb1f-42f2-82fc-6d2f6157e1e2 tempest-ServerActionsTestOtherA-191550997 None] Lock "cinder-8986f984-24d9-491c-834c-89dcfd9fd0ff-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:18:12 devstack sudo[92484]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0d38080e-74a6-42a7-afe7-5559f50bf7eb tempest-ServerActionsTestOtherA-191550997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-36f501da-f217-4cab-b6ed-7ec0492f45b6" returned: 0 in 0.416s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0d38080e-74a6-42a7-afe7-5559f50bf7eb tempest-ServerActionsTestOtherA-191550997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-36f501da-f217-4cab-b6ed-7ec0492f45b6 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:12 devstack sudo[92498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-36f501da-f217-4cab-b6ed-7ec0492f45b6 Nov 03 08:18:12 devstack sudo[92498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:12 devstack sudo[92487]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0a02a5eb-9914-49d6-a2de-c57fb4a0e712 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.dcaf9658-ef6b-4e02-936d-c65fac614dd0 1G" returned: 0 in 0.436s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0a02a5eb-9914-49d6-a2de-c57fb4a0e712 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feea08c3-b2c3-4257-8e46-a758bcbd658f -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.dcaf9658-ef6b-4e02-936d-c65fac614dd0 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:12 devstack sudo[92500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feea08c3-b2c3-4257-8e46-a758bcbd658f -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.dcaf9658-ef6b-4e02-936d-c65fac614dd0 Nov 03 08:18:12 devstack sudo[92500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:12 devstack sudo[92498]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0d38080e-74a6-42a7-afe7-5559f50bf7eb tempest-ServerActionsTestOtherA-191550997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-36f501da-f217-4cab-b6ed-7ec0492f45b6" returned: 0 in 0.261s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:12 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0d38080e-74a6-42a7-afe7-5559f50bf7eb tempest-ServerActionsTestOtherA-191550997 None] Lock "cinder-quobyte-36f501da-f217-4cab-b6ed-7ec0492f45b6" released by "delete_volume" :: held 0.738s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:18:12 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-0d38080e-74a6-42a7-afe7-5559f50bf7eb tempest-ServerActionsTestOtherA-191550997 None] Created reservations ['9ae9004a-ba58-4c97-9e30-eeef61239aa9', '0d252460-168f-4679-b539-7c1e0938c538', '4b407122-733f-44ea-a2de-f42a688da49f', 'f1eef81d-0bcc-4dac-a529-3d2da092b9ca'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:18:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0d38080e-74a6-42a7-afe7-5559f50bf7eb tempest-ServerActionsTestOtherA-191550997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:18:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0d38080e-74a6-42a7-afe7-5559f50bf7eb tempest-ServerActionsTestOtherA-191550997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:18:13 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0d38080e-74a6-42a7-afe7-5559f50bf7eb tempest-ServerActionsTestOtherA-191550997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:18:13 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0d38080e-74a6-42a7-afe7-5559f50bf7eb tempest-ServerActionsTestOtherA-191550997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:18:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0d38080e-74a6-42a7-afe7-5559f50bf7eb tempest-ServerActionsTestOtherA-191550997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:18:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0d38080e-74a6-42a7-afe7-5559f50bf7eb tempest-ServerActionsTestOtherA-191550997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:13 devstack sudo[92500]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0a02a5eb-9914-49d6-a2de-c57fb4a0e712 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feea08c3-b2c3-4257-8e46-a758bcbd658f -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.dcaf9658-ef6b-4e02-936d-c65fac614dd0" returned: 0 in 0.315s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:13 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-0a02a5eb-9914-49d6-a2de-c57fb4a0e712 tempest-GroupSnapshotsTest-1985507406 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.dcaf9658-ef6b-4e02-936d-c65fac614dd0 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 08:18:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0a02a5eb-9914-49d6-a2de-c57fb4a0e712 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.dcaf9658-ef6b-4e02-936d-c65fac614dd0 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:13 devstack sudo[92507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:18:13 devstack sudo[92507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:13 devstack sudo[92509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.dcaf9658-ef6b-4e02-936d-c65fac614dd0 Nov 03 08:18:13 devstack sudo[92509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:13 devstack sudo[92507]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0d38080e-74a6-42a7-afe7-5559f50bf7eb tempest-ServerActionsTestOtherA-191550997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.260s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:13 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-0d38080e-74a6-42a7-afe7-5559f50bf7eb tempest-ServerActionsTestOtherA-191550997 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:18:13 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-0d38080e-74a6-42a7-afe7-5559f50bf7eb tempest-ServerActionsTestOtherA-191550997 None] Deleted volume successfully. Nov 03 08:18:13 devstack sudo[92509]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0a02a5eb-9914-49d6-a2de-c57fb4a0e712 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.dcaf9658-ef6b-4e02-936d-c65fac614dd0" returned: 0 in 0.276s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:13 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0d38080e-74a6-42a7-afe7-5559f50bf7eb tempest-ServerActionsTestOtherA-191550997 None] Lock "cinder-36f501da-f217-4cab-b6ed-7ec0492f45b6-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:18:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0a02a5eb-9914-49d6-a2de-c57fb4a0e712 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:13 devstack sudo[92514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.info Nov 03 08:18:13 devstack sudo[92514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:13 devstack sudo[92514]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0a02a5eb-9914-49d6-a2de-c57fb4a0e712 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.info" returned: 0 in 0.291s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:13 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-0a02a5eb-9914-49d6-a2de-c57fb4a0e712 tempest-GroupSnapshotsTest-1985507406 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 08:18:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0a02a5eb-9914-49d6-a2de-c57fb4a0e712 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:13 devstack sudo[92528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.info Nov 03 08:18:13 devstack sudo[92528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:14 devstack sudo[92528]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0a02a5eb-9914-49d6-a2de-c57fb4a0e712 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.info" returned: 0 in 0.352s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0a02a5eb-9914-49d6-a2de-c57fb4a0e712 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.242s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:18:14 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-0a02a5eb-9914-49d6-a2de-c57fb4a0e712 tempest-GroupSnapshotsTest-1985507406 None] group_snapshot abdec97b-f2e9-4f60-9255-4f8dde39ea4d: created successfully Nov 03 08:18:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:18:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:18:15 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "cinder-quobyte-dcaf9658-ef6b-4e02-936d-c65fac614dd0-aa54cbf8-18bc-4593-94dc-3d177118083d" by "_create_volume_from_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:18:15 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-dcaf9658-ef6b-4e02-936d-c65fac614dd0-aa54cbf8-18bc-4593-94dc-3d177118083d" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:18:15 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Creating volume aa54cbf8-18bc-4593-94dc-3d177118083d from snapshot dcaf9658-ef6b-4e02-936d-c65fac614dd0 {{(pid=86801) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 08:18:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:18:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:18:15 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:18:15 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:18:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:18:15 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:18:15 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "cinder-quobyte-aa54cbf8-18bc-4593-94dc-3d177118083d" by "_copy_volume_from_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:18:15 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-aa54cbf8-18bc-4593-94dc-3d177118083d" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:18:15 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] snapshot: dcaf9658-ef6b-4e02-936d-c65fac614dd0, volume: aa54cbf8-18bc-4593-94dc-3d177118083d, {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 08:18:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:18:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:18:15 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:18:15 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:18:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:18:16 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d9dc7d-6016-4cc1-89ec-4be5da44e68a]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:18:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.dcaf9658-ef6b-4e02-936d-c65fac614dd0 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:16 devstack sudo[92545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.dcaf9658-ef6b-4e02-936d-c65fac614dd0 Nov 03 08:18:16 devstack sudo[92545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:16 devstack sudo[92545]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.dcaf9658-ef6b-4e02-936d-c65fac614dd0" returned: 0 in 0.505s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feea08c3-b2c3-4257-8e46-a758bcbd658f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:18:16 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac84ade-83c7-4e78-a22d-01ae65b9c372]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:18:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:16 devstack sudo[92550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f Nov 03 08:18:16 devstack sudo[92550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:16 devstack sudo[92550]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f" returned: 0 in 0.404s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 08:18:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Creating direct copy from snapshot {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 08:18:16 devstack cinder-volume[86801]: DEBUG cinder.utils [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Path /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aa54cbf8-18bc-4593-94dc-3d177118083d not found in is_blk_device check {{(pid=86801) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 08:18:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aa54cbf8-18bc-4593-94dc-3d177118083d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:16 devstack sudo[92555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aa54cbf8-18bc-4593-94dc-3d177118083d Nov 03 08:18:16 devstack sudo[92555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:19 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:18:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Flow 'volume_create_manager' (88d05f87-699b-44cb-9222-77800a6ab51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:18:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd5a30f-ee3f-47f6-809d-ad862349c32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:18:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd5a30f-ee3f-47f6-809d-ad862349c32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2003601184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96075fb6-a215-4b88-9ca9-8f3cd91aab5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1aed2ea7e845bbb65bba40dde65fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:19Z,use_quota=True,user_id='f81cdd381f0148b7adc87126ea95b1b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:18:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b932948-b8f4-480e-89ca-03f3322c7296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:18:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b932948-b8f4-480e-89ca-03f3322c7296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:18:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d94735-e658-4e01-a1dc-3c56c4e40c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:18:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d94735-e658-4e01-a1dc-3c56c4e40c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96075fb6-a215-4b88-9ca9-8f3cd91aab5b', 'volume_name': 'volume-96075fb6-a215-4b88-9ca9-8f3cd91aab5b', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:18:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff446a58-af4f-441c-ad44-296476add3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:18:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff446a58-af4f-441c-ad44-296476add3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:18:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b74443b-e86f-49e6-873f-88f3b91e4625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:18:19 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Volume 96075fb6-a215-4b88-9ca9-8f3cd91aab5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96075fb6-a215-4b88-9ca9-8f3cd91aab5b', 'volume_size': 1} Nov 03 08:18:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:18:24 devstack sudo[92555]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aa54cbf8-18bc-4593-94dc-3d177118083d" returned: 0 in 7.929s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:24 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f, size 1024.00 MB, duration 7.93 sec, destination /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aa54cbf8-18bc-4593-94dc-3d177118083d {{(pid=86801) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 08:18:24 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Converted 1024.00 MB image at 129.13 MB/s Nov 03 08:18:24 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aa54cbf8-18bc-4593-94dc-3d177118083d is being set with open permissions: ugo+rw: NotImplementedError Nov 03 08:18:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aa54cbf8-18bc-4593-94dc-3d177118083d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:24 devstack sudo[92585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aa54cbf8-18bc-4593-94dc-3d177118083d Nov 03 08:18:24 devstack sudo[92585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:25 devstack sudo[92585]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aa54cbf8-18bc-4593-94dc-3d177118083d" returned: 0 in 0.253s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-aa54cbf8-18bc-4593-94dc-3d177118083d" released by "_copy_volume_from_snapshot" :: held 9.220s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:18:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-dcaf9658-ef6b-4e02-936d-c65fac614dd0-aa54cbf8-18bc-4593-94dc-3d177118083d" released by "_create_volume_from_snapshot" :: held 9.291s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:18:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.320s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:18:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.676s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:18:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2003601184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96075fb6-a215-4b88-9ca9-8f3cd91aab5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1aed2ea7e845bbb65bba40dde65fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:19Z,use_quota=True,user_id='f81cdd381f0148b7adc87126ea95b1b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:18:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Creating volume 96075fb6-a215-4b88-9ca9-8f3cd91aab5b {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:18:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:18:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:18:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:18:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:18:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:18:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:18:25 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:18:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-96075fb6-a215-4b88-9ca9-8f3cd91aab5b 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:25 devstack sudo[92588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-96075fb6-a215-4b88-9ca9-8f3cd91aab5b 1073741824 Nov 03 08:18:25 devstack sudo[92588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:25 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-88ad54c1-b081-4db8-96f8-7b21bee01bd2 tempest-GroupSnapshotsTest-1985507406 None] Create group from source-snapshot-abdec97b-f2e9-4f60-9255-4f8dde39ea4d completed successfully. Nov 03 08:18:25 devstack sudo[92588]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-96075fb6-a215-4b88-9ca9-8f3cd91aab5b 1073741824" returned: 0 in 0.452s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-96075fb6-a215-4b88-9ca9-8f3cd91aab5b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:25 devstack sudo[92593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-96075fb6-a215-4b88-9ca9-8f3cd91aab5b Nov 03 08:18:25 devstack sudo[92593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:25 devstack sudo[92593]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-96075fb6-a215-4b88-9ca9-8f3cd91aab5b" returned: 0 in 0.242s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:18:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:18:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b74443b-e86f-49e6-873f-88f3b91e4625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96075fb6-a215-4b88-9ca9-8f3cd91aab5b', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:18:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05686f6-f8ab-47e4-af2e-1bc722fbb88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:18:25 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Volume volume-96075fb6-a215-4b88-9ca9-8f3cd91aab5b (96075fb6-a215-4b88-9ca9-8f3cd91aab5b): created successfully Nov 03 08:18:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05686f6-f8ab-47e4-af2e-1bc722fbb88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:18:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Flow 'volume_create_manager' (88d05f87-699b-44cb-9222-77800a6ab51e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:18:25 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-2e0d7bc5-1246-46bb-b63e-a3ca2534569f tempest-AttachVolumeNegativeTest-1934443952 None] Created volume successfully. Nov 03 08:18:26 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e822b2eb-5db0-4dbc-b38a-0448fc7f721d tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "cinder-quobyte-aa54cbf8-18bc-4593-94dc-3d177118083d" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:18:27 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e822b2eb-5db0-4dbc-b38a-0448fc7f721d tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-aa54cbf8-18bc-4593-94dc-3d177118083d" acquired by "delete_volume" :: waited 0.025s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:18:27 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c0f174-22a4-4d0d-8692-a8f1c4ab0050]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:18:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e822b2eb-5db0-4dbc-b38a-0448fc7f721d tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aa54cbf8-18bc-4593-94dc-3d177118083d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:27 devstack sudo[92601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aa54cbf8-18bc-4593-94dc-3d177118083d Nov 03 08:18:27 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:27 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e822b2eb-5db0-4dbc-b38a-0448fc7f721d tempest-GroupSnapshotsTest-1985507406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aa54cbf8-18bc-4593-94dc-3d177118083d" returned: 0 in 0.609s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e822b2eb-5db0-4dbc-b38a-0448fc7f721d tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aa54cbf8-18bc-4593-94dc-3d177118083d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:27 devstack sudo[92614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aa54cbf8-18bc-4593-94dc-3d177118083d Nov 03 08:18:27 devstack sudo[92614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-875d8302-bb25-4062-be07-0a811eb053b0 req-66db011e-c0f0-42b9-be4a-df84367003a1 tempest-AttachVolumeNegativeTest-1934443952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:18:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-875d8302-bb25-4062-be07-0a811eb053b0 req-66db011e-c0f0-42b9-be4a-df84367003a1 tempest-AttachVolumeNegativeTest-1934443952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:18:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-875d8302-bb25-4062-be07-0a811eb053b0 req-66db011e-c0f0-42b9-be4a-df84367003a1 tempest-AttachVolumeNegativeTest-1934443952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:18:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-875d8302-bb25-4062-be07-0a811eb053b0 req-66db011e-c0f0-42b9-be4a-df84367003a1 tempest-AttachVolumeNegativeTest-1934443952 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f', 'name': 'volume-96075fb6-a215-4b88-9ca9-8f3cd91aab5b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88799652-5c57-44c3-be97-11d3e9ad4db8', 'enforce_multipath': True} {{(pid=86801) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 08:18:27 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-875d8302-bb25-4062-be07-0a811eb053b0 req-66db011e-c0f0-42b9-be4a-df84367003a1 tempest-AttachVolumeNegativeTest-1934443952 None] attachment_update completed successfully. Nov 03 08:18:27 devstack sudo[92614]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e822b2eb-5db0-4dbc-b38a-0448fc7f721d tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aa54cbf8-18bc-4593-94dc-3d177118083d" returned: 0 in 0.288s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:27 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e822b2eb-5db0-4dbc-b38a-0448fc7f721d tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-aa54cbf8-18bc-4593-94dc-3d177118083d" released by "delete_volume" :: held 0.978s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:18:28 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-e822b2eb-5db0-4dbc-b38a-0448fc7f721d tempest-GroupSnapshotsTest-1985507406 None] Created reservations ['33d11ad9-32d5-4275-93e9-3a4b21262069'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:18:28 devstack cinder-volume[86801]: WARNING cinder.quota [None req-e822b2eb-5db0-4dbc-b38a-0448fc7f721d tempest-GroupSnapshotsTest-1985507406 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1829771425 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1829771425, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:18:28 devstack cinder-volume[86801]: WARNING cinder.quota [None req-e822b2eb-5db0-4dbc-b38a-0448fc7f721d tempest-GroupSnapshotsTest-1985507406 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1829771425 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1829771425, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:18:28 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-e822b2eb-5db0-4dbc-b38a-0448fc7f721d tempest-GroupSnapshotsTest-1985507406 None] Created reservations ['0bd51a43-cca7-4820-82a1-90bcd4f8ca3a', '5d4d8fc2-bf47-49c0-a6a5-1b72c870aa65', 'e32c851b-1983-40ad-8922-77c1318d62fd', '7317a434-bfcb-4979-adc0-9de4b3bd40c5'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:18:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e822b2eb-5db0-4dbc-b38a-0448fc7f721d tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:18:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e822b2eb-5db0-4dbc-b38a-0448fc7f721d tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:18:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e822b2eb-5db0-4dbc-b38a-0448fc7f721d tempest-GroupSnapshotsTest-1985507406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:18:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e822b2eb-5db0-4dbc-b38a-0448fc7f721d tempest-GroupSnapshotsTest-1985507406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:18:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e822b2eb-5db0-4dbc-b38a-0448fc7f721d tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:18:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e822b2eb-5db0-4dbc-b38a-0448fc7f721d tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:28 devstack sudo[92720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:18:28 devstack sudo[92720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:28 devstack sudo[92720]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e822b2eb-5db0-4dbc-b38a-0448fc7f721d tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.285s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:28 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-e822b2eb-5db0-4dbc-b38a-0448fc7f721d tempest-GroupSnapshotsTest-1985507406 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:18:28 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-e822b2eb-5db0-4dbc-b38a-0448fc7f721d tempest-GroupSnapshotsTest-1985507406 None] Delete group completed successfully. Nov 03 08:18:29 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-88a17891-0b3f-4744-b229-0f77e649693e tempest-GroupSnapshotsTest-1985507406 None] group_snapshot abdec97b-f2e9-4f60-9255-4f8dde39ea4d: deleting Nov 03 08:18:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-88a17891-0b3f-4744-b229-0f77e649693e tempest-GroupSnapshotsTest-1985507406 None] group_snapshot abdec97b-f2e9-4f60-9255-4f8dde39ea4d: deleting {{(pid=86801) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 08:18:29 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-88a17891-0b3f-4744-b229-0f77e649693e tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "cinder-quobyte-feea08c3-b2c3-4257-8e46-a758bcbd658f" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:18:29 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-88a17891-0b3f-4744-b229-0f77e649693e tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-feea08c3-b2c3-4257-8e46-a758bcbd658f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:18:29 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-88a17891-0b3f-4744-b229-0f77e649693e tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "cinder-quobyte-dcaf9658-ef6b-4e02-936d-c65fac614dd0" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:18:29 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-88a17891-0b3f-4744-b229-0f77e649693e tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-dcaf9658-ef6b-4e02-936d-c65fac614dd0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:18:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-88a17891-0b3f-4744-b229-0f77e649693e tempest-GroupSnapshotsTest-1985507406 None] Deleting offline snapshot dcaf9658-ef6b-4e02-936d-c65fac614dd0 of volume feea08c3-b2c3-4257-8e46-a758bcbd658f {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:18:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-88a17891-0b3f-4744-b229-0f77e649693e tempest-GroupSnapshotsTest-1985507406 None] snapshot_file for this snap is: volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.dcaf9658-ef6b-4e02-936d-c65fac614dd0 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:18:29 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[9724a39f-f955-44fd-8d9e-72caf342ae0f]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:18:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-88a17891-0b3f-4744-b229-0f77e649693e tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.dcaf9658-ef6b-4e02-936d-c65fac614dd0 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:29 devstack sudo[93037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.dcaf9658-ef6b-4e02-936d-c65fac614dd0 Nov 03 08:18:29 devstack sudo[93037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:29 devstack sudo[93037]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-88a17891-0b3f-4744-b229-0f77e649693e tempest-GroupSnapshotsTest-1985507406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.dcaf9658-ef6b-4e02-936d-c65fac614dd0" returned: 0 in 0.390s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-88a17891-0b3f-4744-b229-0f77e649693e tempest-GroupSnapshotsTest-1985507406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feea08c3-b2c3-4257-8e46-a758bcbd658f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:18:29 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3971ddc-b70f-4898-b203-322193cc6b1f]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:18:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-88a17891-0b3f-4744-b229-0f77e649693e tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:30 devstack sudo[93042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f Nov 03 08:18:30 devstack sudo[93042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:30 devstack sudo[93042]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-88a17891-0b3f-4744-b229-0f77e649693e tempest-GroupSnapshotsTest-1985507406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f" returned: 0 in 0.633s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-88a17891-0b3f-4744-b229-0f77e649693e tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.dcaf9658-ef6b-4e02-936d-c65fac614dd0 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:30 devstack sudo[93049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.dcaf9658-ef6b-4e02-936d-c65fac614dd0 Nov 03 08:18:30 devstack sudo[93049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:30 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-0ec3d3b7-2a94-4788-818a-17cb422bd8e3 req-1e5e4a9c-acb0-48da-a0e4-ea159eb461b7 tempest-AttachVolumeNegativeTest-1934443952 None] Terminate volume connection completed successfully. Nov 03 08:18:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-0ec3d3b7-2a94-4788-818a-17cb422bd8e3 req-1e5e4a9c-acb0-48da-a0e4-ea159eb461b7 tempest-AttachVolumeNegativeTest-1934443952 None] Deleting attachment 88799652-5c57-44c3-be97-11d3e9ad4db8. {{(pid=86801) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 08:18:30 devstack sudo[93049]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-88a17891-0b3f-4744-b229-0f77e649693e tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.dcaf9658-ef6b-4e02-936d-c65fac614dd0" returned: 0 in 0.395s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-88a17891-0b3f-4744-b229-0f77e649693e tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.dcaf9658-ef6b-4e02-936d-c65fac614dd0 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:31 devstack sudo[93080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.dcaf9658-ef6b-4e02-936d-c65fac614dd0 Nov 03 08:18:31 devstack sudo[93080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:31 devstack sudo[93080]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-88a17891-0b3f-4744-b229-0f77e649693e tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f.dcaf9658-ef6b-4e02-936d-c65fac614dd0" returned: 0 in 0.266s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:31 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-88a17891-0b3f-4744-b229-0f77e649693e tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-dcaf9658-ef6b-4e02-936d-c65fac614dd0" released by "_delete_snapshot" :: held 1.806s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:18:31 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-88a17891-0b3f-4744-b229-0f77e649693e tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-feea08c3-b2c3-4257-8e46-a758bcbd658f" released by "delete_snapshot" :: held 1.833s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:18:31 devstack cinder-volume[86801]: WARNING cinder.quota [None req-88a17891-0b3f-4744-b229-0f77e649693e tempest-GroupSnapshotsTest-1985507406 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1829771425 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1829771425, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:18:31 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-88a17891-0b3f-4744-b229-0f77e649693e tempest-GroupSnapshotsTest-1985507406 None] Created reservations ['4c175d32-0e4a-47e0-9a2a-a23609d36603', '8b9daba1-4694-4219-9145-f7c6455dc5fd', '6fcf19d5-3a1d-48ed-9b6d-ecaef171c4d7', 'c8596910-9e20-429c-8865-2d3f130943fd'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:18:31 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-88a17891-0b3f-4744-b229-0f77e649693e tempest-GroupSnapshotsTest-1985507406 None] group_snapshot abdec97b-f2e9-4f60-9255-4f8dde39ea4d: deleted successfully Nov 03 08:18:32 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c4e27add-8f1a-4e1f-bdaf-4f8b5b5e028d tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "cinder-quobyte-feea08c3-b2c3-4257-8e46-a758bcbd658f" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:18:32 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c4e27add-8f1a-4e1f-bdaf-4f8b5b5e028d tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-feea08c3-b2c3-4257-8e46-a758bcbd658f" acquired by "delete_volume" :: waited 0.021s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:18:32 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[639099d3-383c-46f4-9da0-db5769e2067f]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:18:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c4e27add-8f1a-4e1f-bdaf-4f8b5b5e028d tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:32 devstack sudo[93088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f Nov 03 08:18:32 devstack sudo[93088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:32 devstack sudo[93088]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c4e27add-8f1a-4e1f-bdaf-4f8b5b5e028d tempest-GroupSnapshotsTest-1985507406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f" returned: 0 in 0.495s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c4e27add-8f1a-4e1f-bdaf-4f8b5b5e028d tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:32 devstack sudo[93108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f Nov 03 08:18:32 devstack sudo[93108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:33 devstack sudo[93108]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c4e27add-8f1a-4e1f-bdaf-4f8b5b5e028d tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-feea08c3-b2c3-4257-8e46-a758bcbd658f" returned: 0 in 0.316s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c4e27add-8f1a-4e1f-bdaf-4f8b5b5e028d tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-feea08c3-b2c3-4257-8e46-a758bcbd658f" released by "delete_volume" :: held 0.939s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:18:33 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-c4e27add-8f1a-4e1f-bdaf-4f8b5b5e028d tempest-GroupSnapshotsTest-1985507406 None] Created reservations ['213b11db-3685-48ef-97c2-178410be4df8'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:18:33 devstack cinder-volume[86801]: WARNING cinder.db.api [None req-c4e27add-8f1a-4e1f-bdaf-4f8b5b5e028d tempest-GroupSnapshotsTest-1985507406 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1829771425'] Nov 03 08:18:33 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-c4e27add-8f1a-4e1f-bdaf-4f8b5b5e028d tempest-GroupSnapshotsTest-1985507406 None] Created reservations ['b5f0548f-9d1f-4c52-a117-c290457a277a', '9b957b0d-b6b4-42a0-b98b-d0620b66dda4', '10ba1b1f-1621-410e-ada0-d88a077eb0d8', '703dbd50-494e-419d-b34f-73f37db0bc22'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:18:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c4e27add-8f1a-4e1f-bdaf-4f8b5b5e028d tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:18:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c4e27add-8f1a-4e1f-bdaf-4f8b5b5e028d tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:18:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c4e27add-8f1a-4e1f-bdaf-4f8b5b5e028d tempest-GroupSnapshotsTest-1985507406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:18:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c4e27add-8f1a-4e1f-bdaf-4f8b5b5e028d tempest-GroupSnapshotsTest-1985507406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:18:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c4e27add-8f1a-4e1f-bdaf-4f8b5b5e028d tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:18:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c4e27add-8f1a-4e1f-bdaf-4f8b5b5e028d tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:33 devstack sudo[93112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:18:33 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:33 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c4e27add-8f1a-4e1f-bdaf-4f8b5b5e028d tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.298s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:33 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-c4e27add-8f1a-4e1f-bdaf-4f8b5b5e028d tempest-GroupSnapshotsTest-1985507406 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:18:33 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-c4e27add-8f1a-4e1f-bdaf-4f8b5b5e028d tempest-GroupSnapshotsTest-1985507406 None] Delete group completed successfully. Nov 03 08:18:34 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-659ab8b5-445a-45ed-bf58-8d8a6626ac62 tempest-GroupSnapshotsTest-1985507406 None] Group tempest-GroupSnapshotsTest-Group-316537258: creating Nov 03 08:18:34 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-659ab8b5-445a-45ed-bf58-8d8a6626ac62 tempest-GroupSnapshotsTest-1985507406 None] Group tempest-GroupSnapshotsTest-Group-316537258: created successfully Nov 03 08:18:34 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-659ab8b5-445a-45ed-bf58-8d8a6626ac62 tempest-GroupSnapshotsTest-1985507406 None] Create group completed successfully. Nov 03 08:18:35 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:18:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Flow 'volume_create_manager' (ceeddc1c-8446-49d6-90f3-777c1b76c946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:18:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e978c5-d671-4c8a-9740-e3a7db044679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:18:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e978c5-d671-4c8a-9740-e3a7db044679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-530228185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b1dbc5d-2de5-478b-83ef-0ef6b3586f6b,host='devstack@QuobyteHD#QuobyteHD',id=bc06f8b7-1dfb-4189-8c74-011159bbb3b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c894a09b90e4399bc0f766c5373a795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:36Z,use_quota=True,user_id='a4cebff489254c328f5880b328bec86a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1389d653-99de-4d1f-a4a2-ba118bdd21cb),volume_type_id=1389d653-99de-4d1f-a4a2-ba118bdd21cb)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:18:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85740767-8c47-4afe-b857-63360e7cea53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:18:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85740767-8c47-4afe-b857-63360e7cea53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:18:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74bb8a2e-f908-439e-b55b-8c147738e038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:18:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74bb8a2e-f908-439e-b55b-8c147738e038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc06f8b7-1dfb-4189-8c74-011159bbb3b3', 'volume_name': 'volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:18:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd46b0f-6621-4da6-89d3-415524149215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:18:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd46b0f-6621-4da6-89d3-415524149215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:18:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2b284e-76f0-4b94-bb00-236987c1ad15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:18:35 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Volume bc06f8b7-1dfb-4189-8c74-011159bbb3b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3', 'volume_size': 1} Nov 03 08:18:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:18:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:18:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6b1dbc5d-2de5-478b-83ef-0ef6b3586f6b,created_at=2026-11-03T07:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-530228185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b1dbc5d-2de5-478b-83ef-0ef6b3586f6b,host='devstack@QuobyteHD#QuobyteHD',id=bc06f8b7-1dfb-4189-8c74-011159bbb3b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c894a09b90e4399bc0f766c5373a795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:36Z,use_quota=True,user_id='a4cebff489254c328f5880b328bec86a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1389d653-99de-4d1f-a4a2-ba118bdd21cb),volume_type_id=1389d653-99de-4d1f-a4a2-ba118bdd21cb)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:18:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Creating volume bc06f8b7-1dfb-4189-8c74-011159bbb3b3 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:18:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:18:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:18:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:18:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:18:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:18:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:18:36 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:18:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:36 devstack sudo[93119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3 1073741824 Nov 03 08:18:36 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:36 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3 1073741824" returned: 0 in 0.560s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:36 devstack sudo[93125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3 Nov 03 08:18:36 devstack sudo[93125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:36 devstack sudo[93125]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3" returned: 0 in 0.274s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:18:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:18:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2b284e-76f0-4b94-bb00-236987c1ad15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:18:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe3b2eb-d046-4c0d-8751-c5cb02ca94a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:18:36 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Volume volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3 (bc06f8b7-1dfb-4189-8c74-011159bbb3b3): created successfully Nov 03 08:18:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe3b2eb-d046-4c0d-8751-c5cb02ca94a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:18:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Flow 'volume_create_manager' (ceeddc1c-8446-49d6-90f3-777c1b76c946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:18:36 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-25579d43-9202-4849-b1e3-5315676cac8a tempest-GroupSnapshotsTest-1985507406 None] Created volume successfully. Nov 03 08:18:37 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:18:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Flow 'volume_create_manager' (c650e8a8-afac-48e8-8b59-2cb034a511b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:18:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429c08f2-e8a0-46f9-b5c5-605485ebb0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:18:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429c08f2-e8a0-46f9-b5c5-605485ebb0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-942042593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b1dbc5d-2de5-478b-83ef-0ef6b3586f6b,host='devstack@QuobyteHD#QuobyteHD',id=713ba2ef-113d-4a72-aef5-9cf7e7bfe286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c894a09b90e4399bc0f766c5373a795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:38Z,use_quota=True,user_id='a4cebff489254c328f5880b328bec86a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1389d653-99de-4d1f-a4a2-ba118bdd21cb),volume_type_id=1389d653-99de-4d1f-a4a2-ba118bdd21cb)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:18:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd01fadf-c405-4425-9caf-8dd1ca984400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:18:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd01fadf-c405-4425-9caf-8dd1ca984400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:18:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41fa81f-12af-4c07-913b-269163d0fcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:18:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41fa81f-12af-4c07-913b-269163d0fcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '713ba2ef-113d-4a72-aef5-9cf7e7bfe286', 'volume_name': 'volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:18:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d5c901-b348-4a6d-9591-dca3869cb052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:18:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d5c901-b348-4a6d-9591-dca3869cb052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:18:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9280127c-0fd6-4675-b67a-aeb206e5d1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:18:37 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Volume 713ba2ef-113d-4a72-aef5-9cf7e7bfe286: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286', 'volume_size': 1} Nov 03 08:18:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:18:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:18:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6b1dbc5d-2de5-478b-83ef-0ef6b3586f6b,created_at=2026-11-03T07:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-942042593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b1dbc5d-2de5-478b-83ef-0ef6b3586f6b,host='devstack@QuobyteHD#QuobyteHD',id=713ba2ef-113d-4a72-aef5-9cf7e7bfe286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c894a09b90e4399bc0f766c5373a795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:18:38Z,use_quota=True,user_id='a4cebff489254c328f5880b328bec86a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1389d653-99de-4d1f-a4a2-ba118bdd21cb),volume_type_id=1389d653-99de-4d1f-a4a2-ba118bdd21cb)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:18:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Creating volume 713ba2ef-113d-4a72-aef5-9cf7e7bfe286 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:18:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:18:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:18:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:18:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:18:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:18:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:18:37 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:18:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:38 devstack sudo[93128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286 1073741824 Nov 03 08:18:38 devstack sudo[93128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:38 devstack sudo[93128]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286 1073741824" returned: 0 in 0.604s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:38 devstack sudo[93134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286 Nov 03 08:18:38 devstack sudo[93134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:38 devstack sudo[93134]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286" returned: 0 in 0.299s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:18:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:18:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9280127c-0fd6-4675-b67a-aeb206e5d1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:18:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (845a0efd-807c-4337-b449-7c5b126cd047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:18:38 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Volume volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286 (713ba2ef-113d-4a72-aef5-9cf7e7bfe286): created successfully Nov 03 08:18:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (845a0efd-807c-4337-b449-7c5b126cd047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:18:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Flow 'volume_create_manager' (c650e8a8-afac-48e8-8b59-2cb034a511b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:18:39 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-e5f448a2-9502-4b7c-91fe-0e56f5e00584 tempest-GroupSnapshotsTest-1985507406 None] Created volume successfully. Nov 03 08:18:40 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-1d667e86-3b53-43a6-92cf-eaea09995c7a tempest-GroupSnapshotsTest-1985507406 None] Update group completed successfully. Nov 03 08:18:41 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-ca309137-076f-4ee5-a068-9fc3332b8584 tempest-GroupSnapshotsTest-1985507406 None] Update group completed successfully. Nov 03 08:18:43 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-149960e6-85c5-499a-97ef-f0794f1d6f73 tempest-GroupSnapshotsTest-1985507406 None] Update group completed successfully. Nov 03 08:18:44 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-5e3f4472-a6ca-4b0f-8f87-036e62660939 tempest-GroupSnapshotsTest-1985507406 None] Update group completed successfully. Nov 03 08:18:45 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] GroupSnapshot da302e46-6133-4cb7-bfa8-e833d4c05169: creating. Nov 03 08:18:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] Group snapshot da302e46-6133-4cb7-bfa8-e833d4c05169: creating. {{(pid=86801) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 08:18:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:18:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:18:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] Creating offline snapshot a8ac9c6f-c195-42a6-aa67-bb2af80e7b60 of volume bc06f8b7-1dfb-4189-8c74-011159bbb3b3 {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:18:46 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf282c35-e758-4d5e-b5ac-49f9a6517502]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:18:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:46 devstack sudo[93207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3 Nov 03 08:18:46 devstack sudo[93207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:46 devstack sudo[93207]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3" returned: 0 in 0.460s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3.a8ac9c6f-c195-42a6-aa67-bb2af80e7b60 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:46 devstack sudo[93213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3.a8ac9c6f-c195-42a6-aa67-bb2af80e7b60 1G Nov 03 08:18:46 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:47 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3.a8ac9c6f-c195-42a6-aa67-bb2af80e7b60 1G" returned: 0 in 0.636s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3.a8ac9c6f-c195-42a6-aa67-bb2af80e7b60 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:47 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3.a8ac9c6f-c195-42a6-aa67-bb2af80e7b60 Nov 03 08:18:47 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:47 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3.a8ac9c6f-c195-42a6-aa67-bb2af80e7b60" returned: 0 in 0.346s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:47 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3.a8ac9c6f-c195-42a6-aa67-bb2af80e7b60 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 08:18:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3.a8ac9c6f-c195-42a6-aa67-bb2af80e7b60 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:47 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3.a8ac9c6f-c195-42a6-aa67-bb2af80e7b60 Nov 03 08:18:47 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:48 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3.a8ac9c6f-c195-42a6-aa67-bb2af80e7b60" returned: 0 in 0.483s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:48 devstack sudo[93254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3.info Nov 03 08:18:48 devstack sudo[93254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:48 devstack sudo[93254]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3.info" returned: 0 in 0.517s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:48 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 08:18:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:48 devstack sudo[93294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3.info Nov 03 08:18:48 devstack sudo[93294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:49 devstack sudo[93294]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3.info" returned: 0 in 0.525s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.152s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:18:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:18:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:18:49 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] Creating offline snapshot e4b8e47d-7436-46d5-af8a-a418725702c7 of volume 713ba2ef-113d-4a72-aef5-9cf7e7bfe286 {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:18:49 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[3111650a-1f29-4cb9-81dc-daf7c1048151]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:18:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:49 devstack sudo[93326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286 Nov 03 08:18:49 devstack sudo[93326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:50 devstack sudo[93326]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286" returned: 0 in 0.829s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286.e4b8e47d-7436-46d5-af8a-a418725702c7 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:50 devstack sudo[93347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286.e4b8e47d-7436-46d5-af8a-a418725702c7 1G Nov 03 08:18:50 devstack sudo[93347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:51 devstack sudo[93347]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286.e4b8e47d-7436-46d5-af8a-a418725702c7 1G" returned: 0 in 1.506s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286.e4b8e47d-7436-46d5-af8a-a418725702c7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:51 devstack sudo[93368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286.e4b8e47d-7436-46d5-af8a-a418725702c7 Nov 03 08:18:51 devstack sudo[93368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:52 devstack sudo[93368]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286.e4b8e47d-7436-46d5-af8a-a418725702c7" returned: 0 in 0.939s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:52 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286.e4b8e47d-7436-46d5-af8a-a418725702c7 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 08:18:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286.e4b8e47d-7436-46d5-af8a-a418725702c7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:52 devstack sudo[93374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286.e4b8e47d-7436-46d5-af8a-a418725702c7 Nov 03 08:18:52 devstack sudo[93374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:53 devstack sudo[93374]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286.e4b8e47d-7436-46d5-af8a-a418725702c7" returned: 0 in 0.781s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:53 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=83,cinder:UPDATE=77,cinder:INSERT=18,cinder:DELETE=4 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:18:53 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=85,cinder:UPDATE=82,cinder:INSERT=16,cinder:DELETE=4 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:18:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:53 devstack sudo[93397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286.info Nov 03 08:18:53 devstack sudo[93397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:54 devstack sudo[93397]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286.info" returned: 0 in 0.897s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:54 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 08:18:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:54 devstack sudo[93441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286.info Nov 03 08:18:54 devstack sudo[93441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:55 devstack sudo[93441]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286.info" returned: 0 in 0.722s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.955s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:18:55 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-e5025f97-0a76-4aff-8627-eb1316e05f28 tempest-GroupSnapshotsTest-1985507406 None] group_snapshot da302e46-6133-4cb7-bfa8-e833d4c05169: created successfully Nov 03 08:18:56 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] group_snapshot da302e46-6133-4cb7-bfa8-e833d4c05169: deleting Nov 03 08:18:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] group_snapshot da302e46-6133-4cb7-bfa8-e833d4c05169: deleting {{(pid=86801) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 08:18:56 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "cinder-quobyte-bc06f8b7-1dfb-4189-8c74-011159bbb3b3" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:18:56 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-bc06f8b7-1dfb-4189-8c74-011159bbb3b3" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:18:56 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "cinder-quobyte-a8ac9c6f-c195-42a6-aa67-bb2af80e7b60" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:18:56 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-a8ac9c6f-c195-42a6-aa67-bb2af80e7b60" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:18:56 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] Deleting offline snapshot a8ac9c6f-c195-42a6-aa67-bb2af80e7b60 of volume bc06f8b7-1dfb-4189-8c74-011159bbb3b3 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:18:56 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] snapshot_file for this snap is: volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3.a8ac9c6f-c195-42a6-aa67-bb2af80e7b60 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:18:56 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b8cd8d-ebc3-46b4-ac3f-727832dcd3a9]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:18:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3.a8ac9c6f-c195-42a6-aa67-bb2af80e7b60 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:57 devstack sudo[93454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3.a8ac9c6f-c195-42a6-aa67-bb2af80e7b60 Nov 03 08:18:57 devstack sudo[93454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:57 devstack sudo[93454]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3.a8ac9c6f-c195-42a6-aa67-bb2af80e7b60" returned: 0 in 0.965s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:57 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:18:57 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63f0d9a-4a67-491e-9ba7-0fba76e35aef]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:18:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:57 devstack sudo[93468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3 Nov 03 08:18:57 devstack sudo[93468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:58 devstack sudo[93468]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3" returned: 0 in 0.716s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3.a8ac9c6f-c195-42a6-aa67-bb2af80e7b60 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:58 devstack sudo[93481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3.a8ac9c6f-c195-42a6-aa67-bb2af80e7b60 Nov 03 08:18:58 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:59 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3.a8ac9c6f-c195-42a6-aa67-bb2af80e7b60" returned: 0 in 0.731s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3.a8ac9c6f-c195-42a6-aa67-bb2af80e7b60 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:18:59 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3.a8ac9c6f-c195-42a6-aa67-bb2af80e7b60 Nov 03 08:18:59 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:18:59 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Nov 03 08:18:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3.a8ac9c6f-c195-42a6-aa67-bb2af80e7b60" returned: 0 in 0.514s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:18:59 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-a8ac9c6f-c195-42a6-aa67-bb2af80e7b60" released by "_delete_snapshot" :: held 3.182s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:18:59 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-bc06f8b7-1dfb-4189-8c74-011159bbb3b3" released by "delete_snapshot" :: held 3.253s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:18:59 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "cinder-quobyte-713ba2ef-113d-4a72-aef5-9cf7e7bfe286" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:18:59 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-713ba2ef-113d-4a72-aef5-9cf7e7bfe286" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:18:59 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "cinder-quobyte-e4b8e47d-7436-46d5-af8a-a418725702c7" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:18:59 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-e4b8e47d-7436-46d5-af8a-a418725702c7" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:18:59 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] Deleting offline snapshot e4b8e47d-7436-46d5-af8a-a418725702c7 of volume 713ba2ef-113d-4a72-aef5-9cf7e7bfe286 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:19:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] snapshot_file for this snap is: volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286.e4b8e47d-7436-46d5-af8a-a418725702c7 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:19:00 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[901b5896-4d8d-468d-ab47-88d4380d8711]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:19:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286.e4b8e47d-7436-46d5-af8a-a418725702c7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:00 devstack sudo[93511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286.e4b8e47d-7436-46d5-af8a-a418725702c7 Nov 03 08:19:00 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:00 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286.e4b8e47d-7436-46d5-af8a-a418725702c7" returned: 0 in 0.921s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:19:01 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[908f2f30-db91-445e-92e6-1b2746394d7c]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:19:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:01 devstack sudo[93552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286 Nov 03 08:19:01 devstack sudo[93552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:02 devstack sudo[93552]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286" returned: 0 in 0.973s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286.e4b8e47d-7436-46d5-af8a-a418725702c7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:02 devstack sudo[93559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286.e4b8e47d-7436-46d5-af8a-a418725702c7 Nov 03 08:19:02 devstack sudo[93559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:02 devstack sudo[93559]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286.e4b8e47d-7436-46d5-af8a-a418725702c7" returned: 0 in 0.524s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286.e4b8e47d-7436-46d5-af8a-a418725702c7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:02 devstack sudo[93565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286.e4b8e47d-7436-46d5-af8a-a418725702c7 Nov 03 08:19:02 devstack sudo[93565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:02 devstack sudo[93565]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286.e4b8e47d-7436-46d5-af8a-a418725702c7" returned: 0 in 0.344s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-e4b8e47d-7436-46d5-af8a-a418725702c7" released by "_delete_snapshot" :: held 3.097s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:19:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-713ba2ef-113d-4a72-aef5-9cf7e7bfe286" released by "delete_snapshot" :: held 3.136s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:19:03 devstack cinder-volume[86801]: WARNING cinder.quota [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-951695901 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-951695901, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:19:03 devstack cinder-volume[86801]: WARNING cinder.quota [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-951695901 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-951695901, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:19:03 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] Created reservations ['89aff003-058a-4f63-babd-f1b0924d7ebf', '5f236203-6df0-4914-9d0c-32ebf5e359ab', '83c1733a-71dd-4048-a36e-66a32fd78583', 'f7daa1d4-0101-4b9f-adb6-fe535f94f0c0'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:19:03 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] Created reservations ['bf1e61b2-d2f8-4536-b7b4-461724515341', '2198fd50-729b-467f-ac98-a2db318ae6fd', 'a22d837b-6697-437c-a4b3-f25183df91c2', '53476081-9ae4-4f98-a667-5ef37fd520f1'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:19:03 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-0a8b9bfd-234a-44c2-ac88-374cd421be57 tempest-GroupSnapshotsTest-1985507406 None] group_snapshot da302e46-6133-4cb7-bfa8-e833d4c05169: deleted successfully Nov 03 08:19:03 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:19:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:19:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:19:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:03 devstack sudo[93574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:19:03 devstack sudo[93574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Flow 'volume_create_manager' (0ea57b4a-df6b-4685-9b37-0e8d5f8d6650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6941708-4185-4239-9170-f77e4b9842b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6941708-4185-4239-9170-f77e4b9842b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-745566483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41498b59-8d56-4bb2-b8b8-3a5041281d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31bb9eb6e774de98d904d2b3c438e06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:04Z,use_quota=True,user_id='2d6c4586541e4fbe8172b647003bc264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e50ce4d-6611-4be1-9a2d-8f02e0534c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e50ce4d-6611-4be1-9a2d-8f02e0534c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f188069-0685-4579-b278-cdbe89709271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f188069-0685-4579-b278-cdbe89709271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41498b59-8d56-4bb2-b8b8-3a5041281d3b', 'volume_name': 'volume-41498b59-8d56-4bb2-b8b8-3a5041281d3b', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dca12bb-8ca3-406e-93b4-ec2ea0211bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dca12bb-8ca3-406e-93b4-ec2ea0211bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (525ce641-162c-4516-9474-d8b71b05283b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:04 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Volume 41498b59-8d56-4bb2-b8b8-3a5041281d3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41498b59-8d56-4bb2-b8b8-3a5041281d3b', 'volume_size': 1} Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-745566483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41498b59-8d56-4bb2-b8b8-3a5041281d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31bb9eb6e774de98d904d2b3c438e06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:04Z,use_quota=True,user_id='2d6c4586541e4fbe8172b647003bc264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Creating volume 41498b59-8d56-4bb2-b8b8-3a5041281d3b {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:19:04 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-41498b59-8d56-4bb2-b8b8-3a5041281d3b 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:04 devstack sudo[93577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-41498b59-8d56-4bb2-b8b8-3a5041281d3b 1073741824 Nov 03 08:19:04 devstack sudo[93577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:04 devstack sudo[93574]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.674s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager._thread_info {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread count: 28 {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread info: [<_MainThread(MainThread, started 139707544170624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-309ba110-9d0a-4035-99d0-47509519dda6 tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "cinder-quobyte-713ba2ef-113d-4a72-aef5-9cf7e7bfe286" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-309ba110-9d0a-4035-99d0-47509519dda6 tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-713ba2ef-113d-4a72-aef5-9cf7e7bfe286" acquired by "delete_volume" :: waited 0.035s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[e675306b-8338-4a30-888b-bf8625b0c3e0]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:19:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-309ba110-9d0a-4035-99d0-47509519dda6 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:05 devstack sudo[93582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286 Nov 03 08:19:05 devstack sudo[93582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:05 devstack sudo[93577]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-41498b59-8d56-4bb2-b8b8-3a5041281d3b 1073741824" returned: 0 in 0.817s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-41498b59-8d56-4bb2-b8b8-3a5041281d3b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:05 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-41498b59-8d56-4bb2-b8b8-3a5041281d3b Nov 03 08:19:05 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:05 devstack sudo[93582]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-309ba110-9d0a-4035-99d0-47509519dda6 tempest-GroupSnapshotsTest-1985507406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286" returned: 0 in 0.886s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-309ba110-9d0a-4035-99d0-47509519dda6 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:05 devstack sudo[93589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286 Nov 03 08:19:05 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:05 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-41498b59-8d56-4bb2-b8b8-3a5041281d3b" returned: 0 in 0.523s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:05 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:19:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (525ce641-162c-4516-9474-d8b71b05283b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41498b59-8d56-4bb2-b8b8-3a5041281d3b', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c9aef9-cd5d-4710-a7c7-0c9d030caf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:05 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Volume volume-41498b59-8d56-4bb2-b8b8-3a5041281d3b (41498b59-8d56-4bb2-b8b8-3a5041281d3b): created successfully Nov 03 08:19:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c9aef9-cd5d-4710-a7c7-0c9d030caf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Flow 'volume_create_manager' (0ea57b4a-df6b-4685-9b37-0e8d5f8d6650) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:19:05 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-8e64ee8a-034c-4393-a4f1-38a411c13cde tempest-ServerRescueNegativeTestJSON-198091541 None] Created volume successfully. Nov 03 08:19:06 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-309ba110-9d0a-4035-99d0-47509519dda6 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-713ba2ef-113d-4a72-aef5-9cf7e7bfe286" returned: 0 in 0.506s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:06 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-309ba110-9d0a-4035-99d0-47509519dda6 tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-713ba2ef-113d-4a72-aef5-9cf7e7bfe286" released by "delete_volume" :: held 1.561s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:19:06 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-309ba110-9d0a-4035-99d0-47509519dda6 tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "cinder-quobyte-bc06f8b7-1dfb-4189-8c74-011159bbb3b3" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:19:06 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-309ba110-9d0a-4035-99d0-47509519dda6 tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-bc06f8b7-1dfb-4189-8c74-011159bbb3b3" acquired by "delete_volume" :: waited 0.035s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:19:06 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e106b4-0621-4efd-821d-e710c91993b3]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:19:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-309ba110-9d0a-4035-99d0-47509519dda6 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:06 devstack sudo[93596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3 Nov 03 08:19:06 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:07 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-309ba110-9d0a-4035-99d0-47509519dda6 tempest-GroupSnapshotsTest-1985507406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3" returned: 0 in 0.642s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-309ba110-9d0a-4035-99d0-47509519dda6 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:07 devstack sudo[93625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3 Nov 03 08:19:07 devstack sudo[93625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:07 devstack sudo[93625]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-309ba110-9d0a-4035-99d0-47509519dda6 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bc06f8b7-1dfb-4189-8c74-011159bbb3b3" returned: 0 in 0.450s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:07 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-309ba110-9d0a-4035-99d0-47509519dda6 tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-bc06f8b7-1dfb-4189-8c74-011159bbb3b3" released by "delete_volume" :: held 1.266s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:19:07 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-309ba110-9d0a-4035-99d0-47509519dda6 tempest-GroupSnapshotsTest-1985507406 None] Created reservations ['ea7eb78e-7089-4f0e-990a-e3b9cf0a1da9'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:19:07 devstack cinder-volume[86801]: WARNING cinder.quota [None req-309ba110-9d0a-4035-99d0-47509519dda6 tempest-GroupSnapshotsTest-1985507406 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-951695901 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-951695901, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:19:07 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-309ba110-9d0a-4035-99d0-47509519dda6 tempest-GroupSnapshotsTest-1985507406 None] Created reservations ['111ad02f-0987-4d70-bc14-a66a5a26faf6', '3c17536b-e142-46b8-8f66-b45cd075f448', '0be0f7ac-9bcb-4df5-a5e1-50c38cb94156', '223ad21b-dcdc-4f04-a0b1-b04a81d6d570'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:19:07 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-309ba110-9d0a-4035-99d0-47509519dda6 tempest-GroupSnapshotsTest-1985507406 None] Created reservations ['726a25df-56b6-4d88-b880-4378360afb79', 'e4d016cc-8d95-4877-8bb7-88c460cec9d9', '89d70848-120e-481f-b705-bca5bcf17752', '9fe05ba5-ba17-45ce-ac73-d6b451bf165f'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:19:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-309ba110-9d0a-4035-99d0-47509519dda6 tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-309ba110-9d0a-4035-99d0-47509519dda6 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:08 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-309ba110-9d0a-4035-99d0-47509519dda6 tempest-GroupSnapshotsTest-1985507406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:19:08 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-309ba110-9d0a-4035-99d0-47509519dda6 tempest-GroupSnapshotsTest-1985507406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:19:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-309ba110-9d0a-4035-99d0-47509519dda6 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-309ba110-9d0a-4035-99d0-47509519dda6 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:08 devstack sudo[93635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:19:08 devstack sudo[93635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:08 devstack sudo[93635]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-309ba110-9d0a-4035-99d0-47509519dda6 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.547s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:08 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-309ba110-9d0a-4035-99d0-47509519dda6 tempest-GroupSnapshotsTest-1985507406 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:19:08 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-309ba110-9d0a-4035-99d0-47509519dda6 tempest-GroupSnapshotsTest-1985507406 None] Delete group completed successfully. Nov 03 08:19:09 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-a08c3e91-1d62-40ba-90d5-976b27c81a25 tempest-GroupSnapshotsTest-1985507406 None] Group tempest-GroupSnapshotsTest-Group-1186329533: creating Nov 03 08:19:09 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-a08c3e91-1d62-40ba-90d5-976b27c81a25 tempest-GroupSnapshotsTest-1985507406 None] Group tempest-GroupSnapshotsTest-Group-1186329533: created successfully Nov 03 08:19:09 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-a08c3e91-1d62-40ba-90d5-976b27c81a25 tempest-GroupSnapshotsTest-1985507406 None] Create group completed successfully. Nov 03 08:19:11 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:19:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Flow 'volume_create_manager' (4957dc16-698e-4138-b658-80cc3bd4e97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:19:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33130077-5cd5-4531-a18e-8752d5ded1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33130077-5cd5-4531-a18e-8752d5ded1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1033952061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=af14f532-6bd5-46a6-bd5b-f4ba37f58e16,host='devstack@QuobyteHD#QuobyteHD',id=25c7c27d-62f3-47bd-9819-257d73d11ada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c894a09b90e4399bc0f766c5373a795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:11Z,use_quota=True,user_id='a4cebff489254c328f5880b328bec86a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c717678-fdcb-444c-94b0-a615933ffed5),volume_type_id=9c717678-fdcb-444c-94b0-a615933ffed5)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df4d8c1-73a2-4cf7-8f1a-3581c42a5b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df4d8c1-73a2-4cf7-8f1a-3581c42a5b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3201723-7c6c-46c0-92ba-34d01af55e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3201723-7c6c-46c0-92ba-34d01af55e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25c7c27d-62f3-47bd-9819-257d73d11ada', 'volume_name': 'volume-25c7c27d-62f3-47bd-9819-257d73d11ada', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e6ab765-bb76-4746-9fea-6580f91b3a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e6ab765-bb76-4746-9fea-6580f91b3a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d57624-01e5-44a5-b98d-aa00d1ff22c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:11 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Volume 25c7c27d-62f3-47bd-9819-257d73d11ada: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25c7c27d-62f3-47bd-9819-257d73d11ada', 'volume_size': 1} Nov 03 08:19:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:11 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=af14f532-6bd5-46a6-bd5b-f4ba37f58e16,created_at=2026-11-03T07:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1033952061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=af14f532-6bd5-46a6-bd5b-f4ba37f58e16,host='devstack@QuobyteHD#QuobyteHD',id=25c7c27d-62f3-47bd-9819-257d73d11ada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c894a09b90e4399bc0f766c5373a795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:11Z,use_quota=True,user_id='a4cebff489254c328f5880b328bec86a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c717678-fdcb-444c-94b0-a615933ffed5),volume_type_id=9c717678-fdcb-444c-94b0-a615933ffed5)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:19:11 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Creating volume 25c7c27d-62f3-47bd-9819-257d73d11ada {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:19:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:11 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:19:11 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:19:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:11 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:19:11 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:19:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:11 devstack sudo[93671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada 1073741824 Nov 03 08:19:11 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:12 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada 1073741824" returned: 0 in 0.843s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:12 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada Nov 03 08:19:12 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:13 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada" returned: 0 in 0.389s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:13 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:19:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d57624-01e5-44a5-b98d-aa00d1ff22c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25c7c27d-62f3-47bd-9819-257d73d11ada', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (688403a3-43e3-437b-bd41-90035311fe79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:13 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Volume volume-25c7c27d-62f3-47bd-9819-257d73d11ada (25c7c27d-62f3-47bd-9819-257d73d11ada): created successfully Nov 03 08:19:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (688403a3-43e3-437b-bd41-90035311fe79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Flow 'volume_create_manager' (4957dc16-698e-4138-b658-80cc3bd4e97c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:19:13 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-d899a1f4-2f75-4ae6-b73d-643f77bce4f3 tempest-GroupSnapshotsTest-1985507406 None] Created volume successfully. Nov 03 08:19:14 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-2525c912-7438-494d-8ce9-5454dc2b70a9 tempest-GroupSnapshotsTest-1985507406 None] GroupSnapshot bbf61cd9-e5fb-4dd5-8705-01f7f1c6de74: creating. Nov 03 08:19:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2525c912-7438-494d-8ce9-5454dc2b70a9 tempest-GroupSnapshotsTest-1985507406 None] Group snapshot bbf61cd9-e5fb-4dd5-8705-01f7f1c6de74: creating. {{(pid=86801) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 08:19:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2525c912-7438-494d-8ce9-5454dc2b70a9 tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2525c912-7438-494d-8ce9-5454dc2b70a9 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:14 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-2525c912-7438-494d-8ce9-5454dc2b70a9 tempest-GroupSnapshotsTest-1985507406 None] Creating offline snapshot 71e30a71-fead-4f49-a1ae-33c6fc7207b1 of volume 25c7c27d-62f3-47bd-9819-257d73d11ada {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:19:14 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac235dd-a6fb-4eca-a9b7-330ac0e4e313]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:19:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2525c912-7438-494d-8ce9-5454dc2b70a9 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:14 devstack sudo[93731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada Nov 03 08:19:14 devstack sudo[93731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:15 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8ac43d5a-243a-4a02-ba01-d52aacb2eac3 tempest-ServerRescueNegativeTestJSON-198091541 None] Acquiring lock "cinder-41498b59-8d56-4bb2-b8b8-3a5041281d3b-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:19:15 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8ac43d5a-243a-4a02-ba01-d52aacb2eac3 tempest-ServerRescueNegativeTestJSON-198091541 None] Lock "cinder-41498b59-8d56-4bb2-b8b8-3a5041281d3b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:19:15 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8ac43d5a-243a-4a02-ba01-d52aacb2eac3 tempest-ServerRescueNegativeTestJSON-198091541 None] Acquiring lock "cinder-quobyte-41498b59-8d56-4bb2-b8b8-3a5041281d3b" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:19:15 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8ac43d5a-243a-4a02-ba01-d52aacb2eac3 tempest-ServerRescueNegativeTestJSON-198091541 None] Lock "cinder-quobyte-41498b59-8d56-4bb2-b8b8-3a5041281d3b" acquired by "delete_volume" :: waited 0.026s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:19:15 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0351e93-f39a-4ee4-b763-95462359c140]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:19:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8ac43d5a-243a-4a02-ba01-d52aacb2eac3 tempest-ServerRescueNegativeTestJSON-198091541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-41498b59-8d56-4bb2-b8b8-3a5041281d3b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:15 devstack sudo[93731]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2525c912-7438-494d-8ce9-5454dc2b70a9 tempest-GroupSnapshotsTest-1985507406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada" returned: 0 in 0.691s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:15 devstack sudo[93733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-41498b59-8d56-4bb2-b8b8-3a5041281d3b Nov 03 08:19:15 devstack sudo[93733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2525c912-7438-494d-8ce9-5454dc2b70a9 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada.71e30a71-fead-4f49-a1ae-33c6fc7207b1 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:15 devstack sudo[93738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada.71e30a71-fead-4f49-a1ae-33c6fc7207b1 1G Nov 03 08:19:15 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:15 devstack sudo[93733]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8ac43d5a-243a-4a02-ba01-d52aacb2eac3 tempest-ServerRescueNegativeTestJSON-198091541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-41498b59-8d56-4bb2-b8b8-3a5041281d3b" returned: 0 in 0.620s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8ac43d5a-243a-4a02-ba01-d52aacb2eac3 tempest-ServerRescueNegativeTestJSON-198091541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-41498b59-8d56-4bb2-b8b8-3a5041281d3b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:15 devstack sudo[93747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-41498b59-8d56-4bb2-b8b8-3a5041281d3b Nov 03 08:19:15 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:16 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2525c912-7438-494d-8ce9-5454dc2b70a9 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada.71e30a71-fead-4f49-a1ae-33c6fc7207b1 1G" returned: 0 in 0.600s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2525c912-7438-494d-8ce9-5454dc2b70a9 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25c7c27d-62f3-47bd-9819-257d73d11ada -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada.71e30a71-fead-4f49-a1ae-33c6fc7207b1 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:16 devstack sudo[93750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25c7c27d-62f3-47bd-9819-257d73d11ada -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada.71e30a71-fead-4f49-a1ae-33c6fc7207b1 Nov 03 08:19:16 devstack sudo[93750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:16 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8ac43d5a-243a-4a02-ba01-d52aacb2eac3 tempest-ServerRescueNegativeTestJSON-198091541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-41498b59-8d56-4bb2-b8b8-3a5041281d3b" returned: 0 in 0.301s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:16 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8ac43d5a-243a-4a02-ba01-d52aacb2eac3 tempest-ServerRescueNegativeTestJSON-198091541 None] Lock "cinder-quobyte-41498b59-8d56-4bb2-b8b8-3a5041281d3b" released by "delete_volume" :: held 1.013s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:19:16 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-8ac43d5a-243a-4a02-ba01-d52aacb2eac3 tempest-ServerRescueNegativeTestJSON-198091541 None] Created reservations ['4aef609f-9e15-44bf-88ae-7585fbaf49e5', '524ab345-0442-4bff-bbd9-e67f943ead8f', '9494d8f2-c2ba-49e2-94ac-2b663b57c784', '74c93761-caec-4708-a6b0-1b1b6a94889e'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:19:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8ac43d5a-243a-4a02-ba01-d52aacb2eac3 tempest-ServerRescueNegativeTestJSON-198091541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8ac43d5a-243a-4a02-ba01-d52aacb2eac3 tempest-ServerRescueNegativeTestJSON-198091541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8ac43d5a-243a-4a02-ba01-d52aacb2eac3 tempest-ServerRescueNegativeTestJSON-198091541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:19:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8ac43d5a-243a-4a02-ba01-d52aacb2eac3 tempest-ServerRescueNegativeTestJSON-198091541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:19:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8ac43d5a-243a-4a02-ba01-d52aacb2eac3 tempest-ServerRescueNegativeTestJSON-198091541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8ac43d5a-243a-4a02-ba01-d52aacb2eac3 tempest-ServerRescueNegativeTestJSON-198091541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:16 devstack sudo[93756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:19:16 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:16 devstack sudo[93750]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2525c912-7438-494d-8ce9-5454dc2b70a9 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25c7c27d-62f3-47bd-9819-257d73d11ada -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada.71e30a71-fead-4f49-a1ae-33c6fc7207b1" returned: 0 in 0.412s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:16 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-2525c912-7438-494d-8ce9-5454dc2b70a9 tempest-GroupSnapshotsTest-1985507406 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada.71e30a71-fead-4f49-a1ae-33c6fc7207b1 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 08:19:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2525c912-7438-494d-8ce9-5454dc2b70a9 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada.71e30a71-fead-4f49-a1ae-33c6fc7207b1 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:16 devstack sudo[93763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada.71e30a71-fead-4f49-a1ae-33c6fc7207b1 Nov 03 08:19:16 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:16 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8ac43d5a-243a-4a02-ba01-d52aacb2eac3 tempest-ServerRescueNegativeTestJSON-198091541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.349s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:16 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-8ac43d5a-243a-4a02-ba01-d52aacb2eac3 tempest-ServerRescueNegativeTestJSON-198091541 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:19:16 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-8ac43d5a-243a-4a02-ba01-d52aacb2eac3 tempest-ServerRescueNegativeTestJSON-198091541 None] Deleted volume successfully. Nov 03 08:19:16 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2525c912-7438-494d-8ce9-5454dc2b70a9 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada.71e30a71-fead-4f49-a1ae-33c6fc7207b1" returned: 0 in 0.279s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:16 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8ac43d5a-243a-4a02-ba01-d52aacb2eac3 tempest-ServerRescueNegativeTestJSON-198091541 None] Lock "cinder-41498b59-8d56-4bb2-b8b8-3a5041281d3b-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:19:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2525c912-7438-494d-8ce9-5454dc2b70a9 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:16 devstack sudo[93767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada.info Nov 03 08:19:16 devstack sudo[93767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:17 devstack sudo[93767]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2525c912-7438-494d-8ce9-5454dc2b70a9 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada.info" returned: 0 in 0.286s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:17 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-2525c912-7438-494d-8ce9-5454dc2b70a9 tempest-GroupSnapshotsTest-1985507406 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 08:19:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2525c912-7438-494d-8ce9-5454dc2b70a9 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:17 devstack sudo[93783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada.info Nov 03 08:19:17 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:17 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2525c912-7438-494d-8ce9-5454dc2b70a9 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada.info" returned: 0 in 0.281s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2525c912-7438-494d-8ce9-5454dc2b70a9 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.729s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:17 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-2525c912-7438-494d-8ce9-5454dc2b70a9 tempest-GroupSnapshotsTest-1985507406 None] group_snapshot bbf61cd9-e5fb-4dd5-8705-01f7f1c6de74: created successfully Nov 03 08:19:18 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-cf5b6765-5f03-4e59-90db-ec5e90777846 tempest-GroupSnapshotsTest-1985507406 None] group_snapshot bbf61cd9-e5fb-4dd5-8705-01f7f1c6de74: deleting Nov 03 08:19:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cf5b6765-5f03-4e59-90db-ec5e90777846 tempest-GroupSnapshotsTest-1985507406 None] group_snapshot bbf61cd9-e5fb-4dd5-8705-01f7f1c6de74: deleting {{(pid=86801) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 08:19:18 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-cf5b6765-5f03-4e59-90db-ec5e90777846 tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "cinder-quobyte-25c7c27d-62f3-47bd-9819-257d73d11ada" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:19:18 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-cf5b6765-5f03-4e59-90db-ec5e90777846 tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-25c7c27d-62f3-47bd-9819-257d73d11ada" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:19:18 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-cf5b6765-5f03-4e59-90db-ec5e90777846 tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "cinder-quobyte-71e30a71-fead-4f49-a1ae-33c6fc7207b1" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:19:18 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-cf5b6765-5f03-4e59-90db-ec5e90777846 tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-71e30a71-fead-4f49-a1ae-33c6fc7207b1" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:19:18 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-cf5b6765-5f03-4e59-90db-ec5e90777846 tempest-GroupSnapshotsTest-1985507406 None] Deleting offline snapshot 71e30a71-fead-4f49-a1ae-33c6fc7207b1 of volume 25c7c27d-62f3-47bd-9819-257d73d11ada {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:19:18 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-cf5b6765-5f03-4e59-90db-ec5e90777846 tempest-GroupSnapshotsTest-1985507406 None] snapshot_file for this snap is: volume-25c7c27d-62f3-47bd-9819-257d73d11ada.71e30a71-fead-4f49-a1ae-33c6fc7207b1 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:19:18 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9362265-6e35-44d3-be71-499550c9421d]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:19:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-cf5b6765-5f03-4e59-90db-ec5e90777846 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada.71e30a71-fead-4f49-a1ae-33c6fc7207b1 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:18 devstack sudo[93817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada.71e30a71-fead-4f49-a1ae-33c6fc7207b1 Nov 03 08:19:18 devstack sudo[93817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:19 devstack sudo[93817]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-cf5b6765-5f03-4e59-90db-ec5e90777846 tempest-GroupSnapshotsTest-1985507406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada.71e30a71-fead-4f49-a1ae-33c6fc7207b1" returned: 0 in 0.638s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:19 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-cf5b6765-5f03-4e59-90db-ec5e90777846 tempest-GroupSnapshotsTest-1985507406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25c7c27d-62f3-47bd-9819-257d73d11ada(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:19:19 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfacab30-c7da-4ed7-8b40-2d9eb538dea8]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:19:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-cf5b6765-5f03-4e59-90db-ec5e90777846 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:19 devstack sudo[93823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada Nov 03 08:19:19 devstack sudo[93823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:20 devstack sudo[93823]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-cf5b6765-5f03-4e59-90db-ec5e90777846 tempest-GroupSnapshotsTest-1985507406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada" returned: 0 in 0.831s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-cf5b6765-5f03-4e59-90db-ec5e90777846 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada.71e30a71-fead-4f49-a1ae-33c6fc7207b1 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:20 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada.71e30a71-fead-4f49-a1ae-33c6fc7207b1 Nov 03 08:19:20 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:20 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-cf5b6765-5f03-4e59-90db-ec5e90777846 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada.71e30a71-fead-4f49-a1ae-33c6fc7207b1" returned: 0 in 0.505s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-cf5b6765-5f03-4e59-90db-ec5e90777846 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada.71e30a71-fead-4f49-a1ae-33c6fc7207b1 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:20 devstack sudo[93837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada.71e30a71-fead-4f49-a1ae-33c6fc7207b1 Nov 03 08:19:20 devstack sudo[93837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:20 devstack sudo[93837]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-cf5b6765-5f03-4e59-90db-ec5e90777846 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada.71e30a71-fead-4f49-a1ae-33c6fc7207b1" returned: 0 in 0.367s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:20 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-cf5b6765-5f03-4e59-90db-ec5e90777846 tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-71e30a71-fead-4f49-a1ae-33c6fc7207b1" released by "_delete_snapshot" :: held 2.519s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:19:20 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-cf5b6765-5f03-4e59-90db-ec5e90777846 tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-25c7c27d-62f3-47bd-9819-257d73d11ada" released by "delete_snapshot" :: held 2.568s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:19:20 devstack cinder-volume[86801]: WARNING cinder.quota [None req-cf5b6765-5f03-4e59-90db-ec5e90777846 tempest-GroupSnapshotsTest-1985507406 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1687520533 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1687520533, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:19:20 devstack cinder-volume[86801]: WARNING cinder.quota [None req-cf5b6765-5f03-4e59-90db-ec5e90777846 tempest-GroupSnapshotsTest-1985507406 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1687520533 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1687520533, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:19:21 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-cf5b6765-5f03-4e59-90db-ec5e90777846 tempest-GroupSnapshotsTest-1985507406 None] Created reservations ['f09f2a15-d401-4164-9035-257d2adbc358', 'aea371ad-15fd-4846-8c8e-fb9a3776fed1', 'fd693014-b499-4060-96c2-e1986e16e12e', 'ec59a4c4-2f35-4dd0-b04e-c2695b977526'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:19:21 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-cf5b6765-5f03-4e59-90db-ec5e90777846 tempest-GroupSnapshotsTest-1985507406 None] group_snapshot bbf61cd9-e5fb-4dd5-8705-01f7f1c6de74: deleted successfully Nov 03 08:19:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-61b71441-4eda-42a6-8fe7-33436a2e7d49 tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "cinder-quobyte-25c7c27d-62f3-47bd-9819-257d73d11ada" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:19:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-61b71441-4eda-42a6-8fe7-33436a2e7d49 tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-25c7c27d-62f3-47bd-9819-257d73d11ada" acquired by "delete_volume" :: waited 0.025s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:19:22 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[89379929-fb5b-4d83-9a62-7584370d4ea1]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:19:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-61b71441-4eda-42a6-8fe7-33436a2e7d49 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:22 devstack sudo[93863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada Nov 03 08:19:22 devstack sudo[93863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:22 devstack sudo[93863]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-61b71441-4eda-42a6-8fe7-33436a2e7d49 tempest-GroupSnapshotsTest-1985507406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada" returned: 0 in 0.497s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-61b71441-4eda-42a6-8fe7-33436a2e7d49 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:22 devstack sudo[93869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada Nov 03 08:19:22 devstack sudo[93869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:22 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:19:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Flow 'volume_create_manager' (c93f6110-1063-4427-a845-88bde51cf826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:19:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3eceeff-3c86-4d5e-aee4-7c05924ddc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3eceeff-3c86-4d5e-aee4-7c05924ddc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1129785503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1aed2ea7e845bbb65bba40dde65fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:23Z,use_quota=True,user_id='f81cdd381f0148b7adc87126ea95b1b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ce64087-758a-4485-87aa-6c2c30e97114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ce64087-758a-4485-87aa-6c2c30e97114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffbbee29-0461-4151-8a61-185da0495241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffbbee29-0461-4151-8a61-185da0495241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c', 'volume_name': 'volume-aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539e2743-bf63-4a1f-9131-41ac67219906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539e2743-bf63-4a1f-9131-41ac67219906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f50d61-6260-4075-84c6-4ab4fdd0b067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:23 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Volume aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c', 'volume_size': 1} Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1129785503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1aed2ea7e845bbb65bba40dde65fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:23Z,use_quota=True,user_id='f81cdd381f0148b7adc87126ea95b1b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Creating volume aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:19:23 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:23 devstack sudo[93872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c 1073741824 Nov 03 08:19:23 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:23 devstack sudo[93869]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-61b71441-4eda-42a6-8fe7-33436a2e7d49 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25c7c27d-62f3-47bd-9819-257d73d11ada" returned: 0 in 0.302s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-61b71441-4eda-42a6-8fe7-33436a2e7d49 tempest-GroupSnapshotsTest-1985507406 None] Lock "cinder-quobyte-25c7c27d-62f3-47bd-9819-257d73d11ada" released by "delete_volume" :: held 0.910s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-61b71441-4eda-42a6-8fe7-33436a2e7d49 tempest-GroupSnapshotsTest-1985507406 None] Created reservations ['4c01930a-2f5c-4311-b621-1b3a76532c36'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:19:23 devstack cinder-volume[86801]: WARNING cinder.quota [None req-61b71441-4eda-42a6-8fe7-33436a2e7d49 tempest-GroupSnapshotsTest-1985507406 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1687520533 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1687520533, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-61b71441-4eda-42a6-8fe7-33436a2e7d49 tempest-GroupSnapshotsTest-1985507406 None] Created reservations ['38d34189-cf67-441b-9cff-7bca119e9a18', 'dd8d5b82-480b-47f9-8fb8-34eca5ea2742', '3dbb2eb1-a01e-4a0b-98d1-8cf0f6a71bd4', '612063f1-2ec8-44fc-9ace-554b8413de82'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-61b71441-4eda-42a6-8fe7-33436a2e7d49 tempest-GroupSnapshotsTest-1985507406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-61b71441-4eda-42a6-8fe7-33436a2e7d49 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-61b71441-4eda-42a6-8fe7-33436a2e7d49 tempest-GroupSnapshotsTest-1985507406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-61b71441-4eda-42a6-8fe7-33436a2e7d49 tempest-GroupSnapshotsTest-1985507406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-61b71441-4eda-42a6-8fe7-33436a2e7d49 tempest-GroupSnapshotsTest-1985507406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-61b71441-4eda-42a6-8fe7-33436a2e7d49 tempest-GroupSnapshotsTest-1985507406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:23 devstack sudo[93880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:19:23 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:23 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c 1073741824" returned: 0 in 0.633s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:23 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:23 devstack sudo[93884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c Nov 03 08:19:23 devstack sudo[93884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-61b71441-4eda-42a6-8fe7-33436a2e7d49 tempest-GroupSnapshotsTest-1985507406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.330s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:23 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-61b71441-4eda-42a6-8fe7-33436a2e7d49 tempest-GroupSnapshotsTest-1985507406 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:19:23 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-61b71441-4eda-42a6-8fe7-33436a2e7d49 tempest-GroupSnapshotsTest-1985507406 None] Delete group completed successfully. Nov 03 08:19:24 devstack sudo[93884]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c" returned: 0 in 0.301s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:19:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f50d61-6260-4075-84c6-4ab4fdd0b067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2518e5fc-ffd8-485d-869d-dc36cbdf7502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:24 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Volume volume-aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c (aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c): created successfully Nov 03 08:19:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2518e5fc-ffd8-485d-869d-dc36cbdf7502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Flow 'volume_create_manager' (c93f6110-1063-4427-a845-88bde51cf826) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:19:24 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-e71b6885-723a-446d-9c25-bf32fc36506c tempest-AttachVolumeNegativeTest-1934443952 None] Created volume successfully. Nov 03 08:19:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-dd418792-535a-499a-abc8-6a6bec683cdc req-ac0db01e-9048-4fce-be4b-2b95085bbb90 tempest-AttachVolumeNegativeTest-1934443952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-dd418792-535a-499a-abc8-6a6bec683cdc req-ac0db01e-9048-4fce-be4b-2b95085bbb90 tempest-AttachVolumeNegativeTest-1934443952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-dd418792-535a-499a-abc8-6a6bec683cdc req-ac0db01e-9048-4fce-be4b-2b95085bbb90 tempest-AttachVolumeNegativeTest-1934443952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-dd418792-535a-499a-abc8-6a6bec683cdc req-ac0db01e-9048-4fce-be4b-2b95085bbb90 tempest-AttachVolumeNegativeTest-1934443952 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f', 'name': 'volume-aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e94a1f84-a080-4e0c-928c-e3da4e682ee1', 'enforce_multipath': True} {{(pid=86801) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 08:19:26 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-dd418792-535a-499a-abc8-6a6bec683cdc req-ac0db01e-9048-4fce-be4b-2b95085bbb90 tempest-AttachVolumeNegativeTest-1934443952 None] attachment_update completed successfully. Nov 03 08:19:29 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-07d196b0-c786-437e-9d21-ff4f045bdc01 req-26508ea0-ed46-4d7d-8dac-225e2b8da75f tempest-AttachVolumeNegativeTest-1934443952 None] Terminate volume connection completed successfully. Nov 03 08:19:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-07d196b0-c786-437e-9d21-ff4f045bdc01 req-26508ea0-ed46-4d7d-8dac-225e2b8da75f tempest-AttachVolumeNegativeTest-1934443952 None] Deleting attachment e94a1f84-a080-4e0c-928c-e3da4e682ee1. {{(pid=86801) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 08:19:32 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-12d0e070-b630-42d0-9f0a-1fdd79ccc481 req-6b7b70d8-e804-407b-87cd-3a129f5c757d tempest-AttachVolumeTestJSON-615484012 None] Terminate volume connection completed successfully. Nov 03 08:19:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-12d0e070-b630-42d0-9f0a-1fdd79ccc481 req-6b7b70d8-e804-407b-87cd-3a129f5c757d tempest-AttachVolumeTestJSON-615484012 None] Deleting attachment b564fd5c-2d1d-4c04-8f04-ccddef4f315b. {{(pid=86801) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 08:19:34 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:19:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Flow 'volume_create_manager' (e6b95ea5-b908-4c15-97c7-842c7e4b1224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:19:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b618523-7560-4e35-b212-87f01cc20d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b618523-7560-4e35-b212-87f01cc20d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2090210559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38e483e883847ccbf8e8fa5fe5b2f56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:34Z,use_quota=True,user_id='f664329c72f4491e9c01a2775b905174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b396cafc-68ca-4825-adca-513b96593642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b396cafc-68ca-4825-adca-513b96593642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24f27bd-6f42-4f38-b878-378fc99cf18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24f27bd-6f42-4f38-b878-378fc99cf18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb', 'volume_name': 'volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d86ddb-d091-432c-bc9d-8165391137d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d86ddb-d091-432c-bc9d-8165391137d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d4e166-98cb-4b68-b7a4-6fc279be78c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:34 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Volume 1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb', 'volume_size': 1} Nov 03 08:19:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:34 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2090210559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38e483e883847ccbf8e8fa5fe5b2f56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:34Z,use_quota=True,user_id='f664329c72f4491e9c01a2775b905174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:19:34 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Creating volume 1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:19:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:34 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:19:34 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:19:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:34 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:19:34 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:19:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:34 devstack sudo[94374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb 1073741824 Nov 03 08:19:34 devstack sudo[94374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:35 devstack sudo[94374]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb 1073741824" returned: 0 in 0.661s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:35 devstack sudo[94380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb Nov 03 08:19:35 devstack sudo[94380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:35 devstack sudo[94380]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb" returned: 0 in 0.357s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:19:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d4e166-98cb-4b68-b7a4-6fc279be78c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ab73db-7242-4fef-bf5e-9b76362a2eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:35 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Volume volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb (1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb): created successfully Nov 03 08:19:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ab73db-7242-4fef-bf5e-9b76362a2eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Flow 'volume_create_manager' (e6b95ea5-b908-4c15-97c7-842c7e4b1224) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:19:35 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-1ac5fd8a-998c-4cc7-81e8-236df9015e95 req-0c35b38a-8a3a-4014-86f7-5941dc417aba tempest-VolumesSnapshotsTestJSON-320302435 None] Created volume successfully. Nov 03 08:19:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-2490e1f8-74fe-44ac-ab74-0844f1059d61 tempest-AttachVolumeNegativeTest-1934443952 None] Acquiring lock "cinder-aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:19:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-2490e1f8-74fe-44ac-ab74-0844f1059d61 tempest-AttachVolumeNegativeTest-1934443952 None] Lock "cinder-aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:19:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-2490e1f8-74fe-44ac-ab74-0844f1059d61 tempest-AttachVolumeNegativeTest-1934443952 None] Acquiring lock "cinder-quobyte-aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:19:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-2490e1f8-74fe-44ac-ab74-0844f1059d61 tempest-AttachVolumeNegativeTest-1934443952 None] Lock "cinder-quobyte-aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c" acquired by "delete_volume" :: waited 0.015s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:19:35 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[68523f42-c538-45fc-aec6-1c4e8c418ce7]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:19:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2490e1f8-74fe-44ac-ab74-0844f1059d61 tempest-AttachVolumeNegativeTest-1934443952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:36 devstack sudo[94384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c Nov 03 08:19:36 devstack sudo[94384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:36 devstack sudo[94384]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2490e1f8-74fe-44ac-ab74-0844f1059d61 tempest-AttachVolumeNegativeTest-1934443952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c" returned: 0 in 0.406s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2490e1f8-74fe-44ac-ab74-0844f1059d61 tempest-AttachVolumeNegativeTest-1934443952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:36 devstack sudo[94389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c Nov 03 08:19:36 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:36 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2490e1f8-74fe-44ac-ab74-0844f1059d61 tempest-AttachVolumeNegativeTest-1934443952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c" returned: 0 in 0.335s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-2490e1f8-74fe-44ac-ab74-0844f1059d61 tempest-AttachVolumeNegativeTest-1934443952 None] Lock "cinder-quobyte-aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c" released by "delete_volume" :: held 0.798s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:19:36 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-2490e1f8-74fe-44ac-ab74-0844f1059d61 tempest-AttachVolumeNegativeTest-1934443952 None] Created reservations ['cb95da0f-57de-4124-b49e-ca87546bff84', 'd0d3cefa-ef08-4d3e-b5b7-5ad324701882', '2e794bd9-1b5e-4e58-9fc7-88dc85d6a4c0', '5e474ace-a4a8-4540-9324-73010a4e5ea5'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:19:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2490e1f8-74fe-44ac-ab74-0844f1059d61 tempest-AttachVolumeNegativeTest-1934443952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2490e1f8-74fe-44ac-ab74-0844f1059d61 tempest-AttachVolumeNegativeTest-1934443952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2490e1f8-74fe-44ac-ab74-0844f1059d61 tempest-AttachVolumeNegativeTest-1934443952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:19:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2490e1f8-74fe-44ac-ab74-0844f1059d61 tempest-AttachVolumeNegativeTest-1934443952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:19:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2490e1f8-74fe-44ac-ab74-0844f1059d61 tempest-AttachVolumeNegativeTest-1934443952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2490e1f8-74fe-44ac-ab74-0844f1059d61 tempest-AttachVolumeNegativeTest-1934443952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:36 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:19:36 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-40682068-34a9-4a64-abcd-9587ae945110 req-e900d7d8-e42c-4311-b47b-2e53ad345d29 tempest-VolumesSnapshotsTestJSON-320302435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-40682068-34a9-4a64-abcd-9587ae945110 req-e900d7d8-e42c-4311-b47b-2e53ad345d29 tempest-VolumesSnapshotsTestJSON-320302435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [req-40682068-34a9-4a64-abcd-9587ae945110 req-e900d7d8-e42c-4311-b47b-2e53ad345d29 tempest-VolumesSnapshotsTestJSON-320302435 None] Creating offline snapshot 8eeec0cb-3a5a-43eb-bed3-12ba0a6052bf of volume 1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:19:37 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[8046ce49-c459-4bf5-b63a-862c4ae004c1]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:19:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-40682068-34a9-4a64-abcd-9587ae945110 req-e900d7d8-e42c-4311-b47b-2e53ad345d29 tempest-VolumesSnapshotsTestJSON-320302435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:37 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb Nov 03 08:19:37 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-92d7217e-67ea-430a-a0cf-930fc41fa80b tempest-AttachVolumeNegativeTest-1934443952 None] Acquiring lock "cinder-96075fb6-a215-4b88-9ca9-8f3cd91aab5b-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:19:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-92d7217e-67ea-430a-a0cf-930fc41fa80b tempest-AttachVolumeNegativeTest-1934443952 None] Lock "cinder-96075fb6-a215-4b88-9ca9-8f3cd91aab5b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:19:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-92d7217e-67ea-430a-a0cf-930fc41fa80b tempest-AttachVolumeNegativeTest-1934443952 None] Acquiring lock "cinder-quobyte-96075fb6-a215-4b88-9ca9-8f3cd91aab5b" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:19:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-92d7217e-67ea-430a-a0cf-930fc41fa80b tempest-AttachVolumeNegativeTest-1934443952 None] Lock "cinder-quobyte-96075fb6-a215-4b88-9ca9-8f3cd91aab5b" acquired by "delete_volume" :: waited 0.018s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:19:37 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce11931-1279-47cd-8e40-df1d659b89d1]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:19:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-92d7217e-67ea-430a-a0cf-930fc41fa80b tempest-AttachVolumeNegativeTest-1934443952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-96075fb6-a215-4b88-9ca9-8f3cd91aab5b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:37 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2490e1f8-74fe-44ac-ab74-0844f1059d61 tempest-AttachVolumeNegativeTest-1934443952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.578s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:37 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-2490e1f8-74fe-44ac-ab74-0844f1059d61 tempest-AttachVolumeNegativeTest-1934443952 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:19:37 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-2490e1f8-74fe-44ac-ab74-0844f1059d61 tempest-AttachVolumeNegativeTest-1934443952 None] Deleted volume successfully. Nov 03 08:19:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-2490e1f8-74fe-44ac-ab74-0844f1059d61 tempest-AttachVolumeNegativeTest-1934443952 None] Lock "cinder-aa64f14c-3d7d-45a4-bb2d-9b6ad14e743c-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:19:37 devstack sudo[94397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-96075fb6-a215-4b88-9ca9-8f3cd91aab5b Nov 03 08:19:37 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:37 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-40682068-34a9-4a64-abcd-9587ae945110 req-e900d7d8-e42c-4311-b47b-2e53ad345d29 tempest-VolumesSnapshotsTestJSON-320302435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb" returned: 0 in 0.710s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-40682068-34a9-4a64-abcd-9587ae945110 req-e900d7d8-e42c-4311-b47b-2e53ad345d29 tempest-VolumesSnapshotsTestJSON-320302435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb.8eeec0cb-3a5a-43eb-bed3-12ba0a6052bf 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:37 devstack sudo[94402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb.8eeec0cb-3a5a-43eb-bed3-12ba0a6052bf 1G Nov 03 08:19:37 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:37 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-92d7217e-67ea-430a-a0cf-930fc41fa80b tempest-AttachVolumeNegativeTest-1934443952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-96075fb6-a215-4b88-9ca9-8f3cd91aab5b" returned: 0 in 0.588s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-92d7217e-67ea-430a-a0cf-930fc41fa80b tempest-AttachVolumeNegativeTest-1934443952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-96075fb6-a215-4b88-9ca9-8f3cd91aab5b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:38 devstack sudo[94409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-96075fb6-a215-4b88-9ca9-8f3cd91aab5b Nov 03 08:19:38 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:38 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-40682068-34a9-4a64-abcd-9587ae945110 req-e900d7d8-e42c-4311-b47b-2e53ad345d29 tempest-VolumesSnapshotsTestJSON-320302435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb.8eeec0cb-3a5a-43eb-bed3-12ba0a6052bf 1G" returned: 0 in 0.537s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-40682068-34a9-4a64-abcd-9587ae945110 req-e900d7d8-e42c-4311-b47b-2e53ad345d29 tempest-VolumesSnapshotsTestJSON-320302435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb.8eeec0cb-3a5a-43eb-bed3-12ba0a6052bf {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:38 devstack sudo[94414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb.8eeec0cb-3a5a-43eb-bed3-12ba0a6052bf Nov 03 08:19:38 devstack sudo[94414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:38 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-92d7217e-67ea-430a-a0cf-930fc41fa80b tempest-AttachVolumeNegativeTest-1934443952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-96075fb6-a215-4b88-9ca9-8f3cd91aab5b" returned: 0 in 0.336s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-92d7217e-67ea-430a-a0cf-930fc41fa80b tempest-AttachVolumeNegativeTest-1934443952 None] Lock "cinder-quobyte-96075fb6-a215-4b88-9ca9-8f3cd91aab5b" released by "delete_volume" :: held 0.996s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:19:38 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-92d7217e-67ea-430a-a0cf-930fc41fa80b tempest-AttachVolumeNegativeTest-1934443952 None] Created reservations ['5be3deaf-531c-44a7-b8de-b2f483f69d84', 'f80cf4ec-e968-40bf-bb8e-653f34ad39b8', '4e94bf90-ff43-4d0f-b95a-30210e7db5bf', 'f1ea3749-65e3-4d57-88f0-6af278958bbe'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:19:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-92d7217e-67ea-430a-a0cf-930fc41fa80b tempest-AttachVolumeNegativeTest-1934443952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-92d7217e-67ea-430a-a0cf-930fc41fa80b tempest-AttachVolumeNegativeTest-1934443952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-92d7217e-67ea-430a-a0cf-930fc41fa80b tempest-AttachVolumeNegativeTest-1934443952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:19:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-92d7217e-67ea-430a-a0cf-930fc41fa80b tempest-AttachVolumeNegativeTest-1934443952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:19:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-92d7217e-67ea-430a-a0cf-930fc41fa80b tempest-AttachVolumeNegativeTest-1934443952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-92d7217e-67ea-430a-a0cf-930fc41fa80b tempest-AttachVolumeNegativeTest-1934443952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:38 devstack sudo[94416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:19:38 devstack sudo[94416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:38 devstack sudo[94414]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-40682068-34a9-4a64-abcd-9587ae945110 req-e900d7d8-e42c-4311-b47b-2e53ad345d29 tempest-VolumesSnapshotsTestJSON-320302435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb.8eeec0cb-3a5a-43eb-bed3-12ba0a6052bf" returned: 0 in 0.430s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:38 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [req-40682068-34a9-4a64-abcd-9587ae945110 req-e900d7d8-e42c-4311-b47b-2e53ad345d29 tempest-VolumesSnapshotsTestJSON-320302435 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb.8eeec0cb-3a5a-43eb-bed3-12ba0a6052bf is being set with open permissions: ugo+rw Nov 03 08:19:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-40682068-34a9-4a64-abcd-9587ae945110 req-e900d7d8-e42c-4311-b47b-2e53ad345d29 tempest-VolumesSnapshotsTestJSON-320302435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb.8eeec0cb-3a5a-43eb-bed3-12ba0a6052bf {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:38 devstack sudo[94425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb.8eeec0cb-3a5a-43eb-bed3-12ba0a6052bf Nov 03 08:19:38 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:38 devstack sudo[94416]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-92d7217e-67ea-430a-a0cf-930fc41fa80b tempest-AttachVolumeNegativeTest-1934443952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.331s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:38 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-92d7217e-67ea-430a-a0cf-930fc41fa80b tempest-AttachVolumeNegativeTest-1934443952 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:19:38 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-92d7217e-67ea-430a-a0cf-930fc41fa80b tempest-AttachVolumeNegativeTest-1934443952 None] Deleted volume successfully. Nov 03 08:19:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-92d7217e-67ea-430a-a0cf-930fc41fa80b tempest-AttachVolumeNegativeTest-1934443952 None] Lock "cinder-96075fb6-a215-4b88-9ca9-8f3cd91aab5b-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:19:39 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-40682068-34a9-4a64-abcd-9587ae945110 req-e900d7d8-e42c-4311-b47b-2e53ad345d29 tempest-VolumesSnapshotsTestJSON-320302435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb.8eeec0cb-3a5a-43eb-bed3-12ba0a6052bf" returned: 0 in 0.329s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-40682068-34a9-4a64-abcd-9587ae945110 req-e900d7d8-e42c-4311-b47b-2e53ad345d29 tempest-VolumesSnapshotsTestJSON-320302435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:39 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb.info Nov 03 08:19:39 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:39 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-40682068-34a9-4a64-abcd-9587ae945110 req-e900d7d8-e42c-4311-b47b-2e53ad345d29 tempest-VolumesSnapshotsTestJSON-320302435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb.info" returned: 0 in 0.286s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:39 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [req-40682068-34a9-4a64-abcd-9587ae945110 req-e900d7d8-e42c-4311-b47b-2e53ad345d29 tempest-VolumesSnapshotsTestJSON-320302435 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb.info is being set with open permissions: ugo+rw Nov 03 08:19:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-40682068-34a9-4a64-abcd-9587ae945110 req-e900d7d8-e42c-4311-b47b-2e53ad345d29 tempest-VolumesSnapshotsTestJSON-320302435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:39 devstack sudo[94432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb.info Nov 03 08:19:39 devstack sudo[94432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:39 devstack sudo[94432]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-40682068-34a9-4a64-abcd-9587ae945110 req-e900d7d8-e42c-4311-b47b-2e53ad345d29 tempest-VolumesSnapshotsTestJSON-320302435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb.info" returned: 0 in 0.273s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-40682068-34a9-4a64-abcd-9587ae945110 req-e900d7d8-e42c-4311-b47b-2e53ad345d29 tempest-VolumesSnapshotsTestJSON-320302435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.717s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:39 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-40682068-34a9-4a64-abcd-9587ae945110 req-e900d7d8-e42c-4311-b47b-2e53ad345d29 tempest-VolumesSnapshotsTestJSON-320302435 None] Create snapshot completed successfully Nov 03 08:19:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-327e97c9-bc55-4b10-b8fd-55f994a4c020 tempest-AttachVolumeNegativeTest-1934443952 None] Acquiring lock "cinder-4e358676-9dab-4956-8bdf-cf3cdc3b827d-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:19:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-327e97c9-bc55-4b10-b8fd-55f994a4c020 tempest-AttachVolumeNegativeTest-1934443952 None] Lock "cinder-4e358676-9dab-4956-8bdf-cf3cdc3b827d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:19:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-327e97c9-bc55-4b10-b8fd-55f994a4c020 tempest-AttachVolumeNegativeTest-1934443952 None] Acquiring lock "cinder-quobyte-4e358676-9dab-4956-8bdf-cf3cdc3b827d" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:19:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-327e97c9-bc55-4b10-b8fd-55f994a4c020 tempest-AttachVolumeNegativeTest-1934443952 None] Lock "cinder-quobyte-4e358676-9dab-4956-8bdf-cf3cdc3b827d" acquired by "delete_volume" :: waited 0.015s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:19:39 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e41560b-012d-4e42-a8d2-42a028704aaa]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:19:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-327e97c9-bc55-4b10-b8fd-55f994a4c020 tempest-AttachVolumeNegativeTest-1934443952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4e358676-9dab-4956-8bdf-cf3cdc3b827d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:40 devstack sudo[94435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4e358676-9dab-4956-8bdf-cf3cdc3b827d Nov 03 08:19:40 devstack sudo[94435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:40 devstack sudo[94435]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-327e97c9-bc55-4b10-b8fd-55f994a4c020 tempest-AttachVolumeNegativeTest-1934443952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4e358676-9dab-4956-8bdf-cf3cdc3b827d" returned: 0 in 0.436s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-327e97c9-bc55-4b10-b8fd-55f994a4c020 tempest-AttachVolumeNegativeTest-1934443952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4e358676-9dab-4956-8bdf-cf3cdc3b827d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:40 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4e358676-9dab-4956-8bdf-cf3cdc3b827d Nov 03 08:19:40 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Flow 'volume_create_manager' (c6931303-0c24-4e10-9465-d99bf6c2c203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15ccd596-c60c-446d-a5a7-5aef13584808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15ccd596-c60c-446d-a5a7-5aef13584808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1272758957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2889f15-80f3-4a7a-8822-61ff37980177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e481a7794a4e4225baa16aae0076a1b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:40Z,use_quota=True,user_id='2669978edc344605ba9661a6e8c23f34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecfcf0f7-0d98-452b-9972-149642b8ca5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecfcf0f7-0d98-452b-9972-149642b8ca5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffaff3ba-0f60-4249-862e-c480ed290685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffaff3ba-0f60-4249-862e-c480ed290685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2889f15-80f3-4a7a-8822-61ff37980177', 'volume_name': 'volume-a2889f15-80f3-4a7a-8822-61ff37980177', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0eed67-f300-4c2c-a4d1-60809508068b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0eed67-f300-4c2c-a4d1-60809508068b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb4ebd2c-d97b-41c3-bac4-cbccc6e1853d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:40 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Volume a2889f15-80f3-4a7a-8822-61ff37980177: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2889f15-80f3-4a7a-8822-61ff37980177', 'volume_size': 1} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1272758957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2889f15-80f3-4a7a-8822-61ff37980177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e481a7794a4e4225baa16aae0076a1b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:40Z,use_quota=True,user_id='2669978edc344605ba9661a6e8c23f34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Creating volume a2889f15-80f3-4a7a-8822-61ff37980177 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:19:40 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a2889f15-80f3-4a7a-8822-61ff37980177 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:40 devstack sudo[94443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a2889f15-80f3-4a7a-8822-61ff37980177 1073741824 Nov 03 08:19:40 devstack sudo[94443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:40 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-327e97c9-bc55-4b10-b8fd-55f994a4c020 tempest-AttachVolumeNegativeTest-1934443952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4e358676-9dab-4956-8bdf-cf3cdc3b827d" returned: 0 in 0.286s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-327e97c9-bc55-4b10-b8fd-55f994a4c020 tempest-AttachVolumeNegativeTest-1934443952 None] Lock "cinder-quobyte-4e358676-9dab-4956-8bdf-cf3cdc3b827d" released by "delete_volume" :: held 0.774s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-327e97c9-bc55-4b10-b8fd-55f994a4c020 tempest-AttachVolumeNegativeTest-1934443952 None] Created reservations ['f2f96246-ff68-45b8-b7e4-3d078224940f', '1ae9c86d-1298-4241-8a3d-f6f0e8e7668b', 'f1727d92-4124-4586-b75c-16ad9770c71b', '80f240a6-f767-4936-9ee9-dcc2583339f2'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-327e97c9-bc55-4b10-b8fd-55f994a4c020 tempest-AttachVolumeNegativeTest-1934443952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-327e97c9-bc55-4b10-b8fd-55f994a4c020 tempest-AttachVolumeNegativeTest-1934443952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-327e97c9-bc55-4b10-b8fd-55f994a4c020 tempest-AttachVolumeNegativeTest-1934443952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-327e97c9-bc55-4b10-b8fd-55f994a4c020 tempest-AttachVolumeNegativeTest-1934443952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-327e97c9-bc55-4b10-b8fd-55f994a4c020 tempest-AttachVolumeNegativeTest-1934443952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-327e97c9-bc55-4b10-b8fd-55f994a4c020 tempest-AttachVolumeNegativeTest-1934443952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:40 devstack sudo[94447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:19:40 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-8ebce269-cbcd-4474-a1df-60c33c3b1815 req-91685f84-c606-47e1-a279-24a5fb04c876 tempest-VolumesSnapshotsTestJSON-320302435 None] Acquiring lock "cinder-8eeec0cb-3a5a-43eb-bed3-12ba0a6052bf-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-8ebce269-cbcd-4474-a1df-60c33c3b1815 req-91685f84-c606-47e1-a279-24a5fb04c876 tempest-VolumesSnapshotsTestJSON-320302435 None] Lock "cinder-8eeec0cb-3a5a-43eb-bed3-12ba0a6052bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-8ebce269-cbcd-4474-a1df-60c33c3b1815 req-91685f84-c606-47e1-a279-24a5fb04c876 tempest-VolumesSnapshotsTestJSON-320302435 None] Acquiring lock "cinder-quobyte-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-8ebce269-cbcd-4474-a1df-60c33c3b1815 req-91685f84-c606-47e1-a279-24a5fb04c876 tempest-VolumesSnapshotsTestJSON-320302435 None] Lock "cinder-quobyte-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:19:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-8ebce269-cbcd-4474-a1df-60c33c3b1815 req-91685f84-c606-47e1-a279-24a5fb04c876 tempest-VolumesSnapshotsTestJSON-320302435 None] Acquiring lock "cinder-quobyte-8eeec0cb-3a5a-43eb-bed3-12ba0a6052bf" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:19:41 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-8ebce269-cbcd-4474-a1df-60c33c3b1815 req-91685f84-c606-47e1-a279-24a5fb04c876 tempest-VolumesSnapshotsTestJSON-320302435 None] Lock "cinder-quobyte-8eeec0cb-3a5a-43eb-bed3-12ba0a6052bf" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:19:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [req-8ebce269-cbcd-4474-a1df-60c33c3b1815 req-91685f84-c606-47e1-a279-24a5fb04c876 tempest-VolumesSnapshotsTestJSON-320302435 None] Deleting offline snapshot 8eeec0cb-3a5a-43eb-bed3-12ba0a6052bf of volume 1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:19:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [req-8ebce269-cbcd-4474-a1df-60c33c3b1815 req-91685f84-c606-47e1-a279-24a5fb04c876 tempest-VolumesSnapshotsTestJSON-320302435 None] snapshot_file for this snap is: volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb.8eeec0cb-3a5a-43eb-bed3-12ba0a6052bf {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:19:41 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[283b6c10-55dd-4c16-9b21-dbbb63e659a5]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:19:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-8ebce269-cbcd-4474-a1df-60c33c3b1815 req-91685f84-c606-47e1-a279-24a5fb04c876 tempest-VolumesSnapshotsTestJSON-320302435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb.8eeec0cb-3a5a-43eb-bed3-12ba0a6052bf {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:41 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-327e97c9-bc55-4b10-b8fd-55f994a4c020 tempest-AttachVolumeNegativeTest-1934443952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.335s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:41 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-327e97c9-bc55-4b10-b8fd-55f994a4c020 tempest-AttachVolumeNegativeTest-1934443952 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:19:41 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-327e97c9-bc55-4b10-b8fd-55f994a4c020 tempest-AttachVolumeNegativeTest-1934443952 None] Deleted volume successfully. Nov 03 08:19:41 devstack sudo[94443]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a2889f15-80f3-4a7a-8822-61ff37980177 1073741824" returned: 0 in 0.609s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:41 devstack sudo[94450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb.8eeec0cb-3a5a-43eb-bed3-12ba0a6052bf Nov 03 08:19:41 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-327e97c9-bc55-4b10-b8fd-55f994a4c020 tempest-AttachVolumeNegativeTest-1934443952 None] Lock "cinder-4e358676-9dab-4956-8bdf-cf3cdc3b827d-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:19:41 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a2889f15-80f3-4a7a-8822-61ff37980177 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:41 devstack sudo[94457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a2889f15-80f3-4a7a-8822-61ff37980177 Nov 03 08:19:41 devstack sudo[94457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:41 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-8ebce269-cbcd-4474-a1df-60c33c3b1815 req-91685f84-c606-47e1-a279-24a5fb04c876 tempest-VolumesSnapshotsTestJSON-320302435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb.8eeec0cb-3a5a-43eb-bed3-12ba0a6052bf" returned: 0 in 0.522s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [req-8ebce269-cbcd-4474-a1df-60c33c3b1815 req-91685f84-c606-47e1-a279-24a5fb04c876 tempest-VolumesSnapshotsTestJSON-320302435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:19:41 devstack sudo[94457]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a2889f15-80f3-4a7a-8822-61ff37980177" returned: 0 in 0.348s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:19:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:41 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[438cc47d-0627-4b55-811c-317a5170547b]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:19:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-8ebce269-cbcd-4474-a1df-60c33c3b1815 req-91685f84-c606-47e1-a279-24a5fb04c876 tempest-VolumesSnapshotsTestJSON-320302435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:41 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb4ebd2c-d97b-41c3-bac4-cbccc6e1853d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2889f15-80f3-4a7a-8822-61ff37980177', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:41 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ab16e0-c384-4a2f-9606-7e49d5e80bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:41 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Volume volume-a2889f15-80f3-4a7a-8822-61ff37980177 (a2889f15-80f3-4a7a-8822-61ff37980177): created successfully Nov 03 08:19:41 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ab16e0-c384-4a2f-9606-7e49d5e80bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:41 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Flow 'volume_create_manager' (c6931303-0c24-4e10-9465-d99bf6c2c203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:19:41 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-2123a5cd-e105-41d8-bb3f-aa7515cd6230 tempest-VolumeQuotasNegativeTestJSON-980093826 None] Created volume successfully. Nov 03 08:19:41 devstack sudo[94464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb Nov 03 08:19:41 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:42 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-8ebce269-cbcd-4474-a1df-60c33c3b1815 req-91685f84-c606-47e1-a279-24a5fb04c876 tempest-VolumesSnapshotsTestJSON-320302435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb" returned: 0 in 0.434s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-8ebce269-cbcd-4474-a1df-60c33c3b1815 req-91685f84-c606-47e1-a279-24a5fb04c876 tempest-VolumesSnapshotsTestJSON-320302435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb.8eeec0cb-3a5a-43eb-bed3-12ba0a6052bf {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:42 devstack sudo[94469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb.8eeec0cb-3a5a-43eb-bed3-12ba0a6052bf Nov 03 08:19:42 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:42 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-8ebce269-cbcd-4474-a1df-60c33c3b1815 req-91685f84-c606-47e1-a279-24a5fb04c876 tempest-VolumesSnapshotsTestJSON-320302435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb.8eeec0cb-3a5a-43eb-bed3-12ba0a6052bf" returned: 0 in 0.421s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-8ebce269-cbcd-4474-a1df-60c33c3b1815 req-91685f84-c606-47e1-a279-24a5fb04c876 tempest-VolumesSnapshotsTestJSON-320302435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb.8eeec0cb-3a5a-43eb-bed3-12ba0a6052bf {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:42 devstack sudo[94475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb.8eeec0cb-3a5a-43eb-bed3-12ba0a6052bf Nov 03 08:19:42 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:42 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-8ebce269-cbcd-4474-a1df-60c33c3b1815 req-91685f84-c606-47e1-a279-24a5fb04c876 tempest-VolumesSnapshotsTestJSON-320302435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb.8eeec0cb-3a5a-43eb-bed3-12ba0a6052bf" returned: 0 in 0.434s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-8ebce269-cbcd-4474-a1df-60c33c3b1815 req-91685f84-c606-47e1-a279-24a5fb04c876 tempest-VolumesSnapshotsTestJSON-320302435 None] Lock "cinder-quobyte-8eeec0cb-3a5a-43eb-bed3-12ba0a6052bf" released by "_delete_snapshot" :: held 2.026s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:19:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-8ebce269-cbcd-4474-a1df-60c33c3b1815 req-91685f84-c606-47e1-a279-24a5fb04c876 tempest-VolumesSnapshotsTestJSON-320302435 None] Lock "cinder-quobyte-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb" released by "delete_snapshot" :: held 2.085s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:19:43 devstack cinder-volume[86801]: WARNING cinder.quota [req-8ebce269-cbcd-4474-a1df-60c33c3b1815 req-91685f84-c606-47e1-a279-24a5fb04c876 tempest-VolumesSnapshotsTestJSON-320302435 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:19:43 devstack cinder-volume[86801]: DEBUG cinder.quota [req-8ebce269-cbcd-4474-a1df-60c33c3b1815 req-91685f84-c606-47e1-a279-24a5fb04c876 tempest-VolumesSnapshotsTestJSON-320302435 None] Created reservations ['4e3fc7ed-6fa3-4d07-88ed-6b56d228535c', '2899823f-fbb9-4ad2-9d62-b5f0e7114c9e', 'e11b524d-186a-415d-8556-4f8346ab2550', '41245c72-b63d-422a-a549-e91e07f18b9f'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:19:43 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-8ebce269-cbcd-4474-a1df-60c33c3b1815 req-91685f84-c606-47e1-a279-24a5fb04c876 tempest-VolumesSnapshotsTestJSON-320302435 None] Delete snapshot completed successfully. Nov 03 08:19:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-8ebce269-cbcd-4474-a1df-60c33c3b1815 req-91685f84-c606-47e1-a279-24a5fb04c876 tempest-VolumesSnapshotsTestJSON-320302435 None] Lock "cinder-8eeec0cb-3a5a-43eb-bed3-12ba0a6052bf-delete_snapshot" released by "delete_snapshot" :: held 2.385s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:19:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0844684b-8602-44f9-9249-8f2b8ef7a6ba tempest-VolumeQuotasNegativeTestJSON-980093826 None] Acquiring lock "cinder-a2889f15-80f3-4a7a-8822-61ff37980177-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:19:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-bb33384c-a92f-478d-893d-e591c823480e req-03442fb0-08e7-4e14-a5c6-f0111d22e335 tempest-VolumesSnapshotsTestJSON-320302435 None] Acquiring lock "cinder-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:19:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0844684b-8602-44f9-9249-8f2b8ef7a6ba tempest-VolumeQuotasNegativeTestJSON-980093826 None] Lock "cinder-a2889f15-80f3-4a7a-8822-61ff37980177-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:19:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-bb33384c-a92f-478d-893d-e591c823480e req-03442fb0-08e7-4e14-a5c6-f0111d22e335 tempest-VolumesSnapshotsTestJSON-320302435 None] Lock "cinder-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:19:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0844684b-8602-44f9-9249-8f2b8ef7a6ba tempest-VolumeQuotasNegativeTestJSON-980093826 None] Acquiring lock "cinder-quobyte-a2889f15-80f3-4a7a-8822-61ff37980177" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:19:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0844684b-8602-44f9-9249-8f2b8ef7a6ba tempest-VolumeQuotasNegativeTestJSON-980093826 None] Lock "cinder-quobyte-a2889f15-80f3-4a7a-8822-61ff37980177" acquired by "delete_volume" :: waited 0.028s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:19:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-bb33384c-a92f-478d-893d-e591c823480e req-03442fb0-08e7-4e14-a5c6-f0111d22e335 tempest-VolumesSnapshotsTestJSON-320302435 None] Acquiring lock "cinder-quobyte-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:19:44 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb30c30-2ef7-40ad-b09a-a0c3906929ab]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:19:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0844684b-8602-44f9-9249-8f2b8ef7a6ba tempest-VolumeQuotasNegativeTestJSON-980093826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a2889f15-80f3-4a7a-8822-61ff37980177 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-bb33384c-a92f-478d-893d-e591c823480e req-03442fb0-08e7-4e14-a5c6-f0111d22e335 tempest-VolumesSnapshotsTestJSON-320302435 None] Lock "cinder-quobyte-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb" acquired by "delete_volume" :: waited 0.040s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:19:44 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4390af-c130-4516-b0bf-591acb5743c8]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:19:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-bb33384c-a92f-478d-893d-e591c823480e req-03442fb0-08e7-4e14-a5c6-f0111d22e335 tempest-VolumesSnapshotsTestJSON-320302435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:44 devstack sudo[94496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a2889f15-80f3-4a7a-8822-61ff37980177 Nov 03 08:19:44 devstack sudo[94496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:44 devstack sudo[94497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb Nov 03 08:19:44 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:44 devstack sudo[94496]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0844684b-8602-44f9-9249-8f2b8ef7a6ba tempest-VolumeQuotasNegativeTestJSON-980093826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a2889f15-80f3-4a7a-8822-61ff37980177" returned: 0 in 0.473s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0844684b-8602-44f9-9249-8f2b8ef7a6ba tempest-VolumeQuotasNegativeTestJSON-980093826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a2889f15-80f3-4a7a-8822-61ff37980177 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:45 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a2889f15-80f3-4a7a-8822-61ff37980177 Nov 03 08:19:45 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:45 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-bb33384c-a92f-478d-893d-e591c823480e req-03442fb0-08e7-4e14-a5c6-f0111d22e335 tempest-VolumesSnapshotsTestJSON-320302435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb" returned: 0 in 0.430s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-bb33384c-a92f-478d-893d-e591c823480e req-03442fb0-08e7-4e14-a5c6-f0111d22e335 tempest-VolumesSnapshotsTestJSON-320302435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:45 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb Nov 03 08:19:45 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:45 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0844684b-8602-44f9-9249-8f2b8ef7a6ba tempest-VolumeQuotasNegativeTestJSON-980093826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a2889f15-80f3-4a7a-8822-61ff37980177" returned: 0 in 0.343s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:45 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0844684b-8602-44f9-9249-8f2b8ef7a6ba tempest-VolumeQuotasNegativeTestJSON-980093826 None] Lock "cinder-quobyte-a2889f15-80f3-4a7a-8822-61ff37980177" released by "delete_volume" :: held 0.862s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:19:45 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-bb33384c-a92f-478d-893d-e591c823480e req-03442fb0-08e7-4e14-a5c6-f0111d22e335 tempest-VolumesSnapshotsTestJSON-320302435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb" returned: 0 in 0.297s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:45 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-bb33384c-a92f-478d-893d-e591c823480e req-03442fb0-08e7-4e14-a5c6-f0111d22e335 tempest-VolumesSnapshotsTestJSON-320302435 None] Lock "cinder-quobyte-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb" released by "delete_volume" :: held 0.872s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:19:45 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-0844684b-8602-44f9-9249-8f2b8ef7a6ba tempest-VolumeQuotasNegativeTestJSON-980093826 None] Created reservations ['171e0bde-ffc8-4706-a1a5-ab90625d1bde', 'e0e12eb7-04b3-427c-90d3-38928fdca8dd', '5e7dd279-3866-4d66-9303-31cb06fb2be5', '72e787f7-7519-4e9c-aff1-8dccea0ec17e'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:19:45 devstack cinder-volume[86801]: DEBUG cinder.quota [req-bb33384c-a92f-478d-893d-e591c823480e req-03442fb0-08e7-4e14-a5c6-f0111d22e335 tempest-VolumesSnapshotsTestJSON-320302435 None] Created reservations ['eed68fd2-60dc-4652-9ffc-39998c79b1e2', '4df278e8-e254-413e-a174-c37a0ff10ec9', '6cfe67cf-0c61-4758-b213-9bc2fed19730', '79fcff27-f618-4c7a-9ad3-a91fed6c2c2a'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:19:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0844684b-8602-44f9-9249-8f2b8ef7a6ba tempest-VolumeQuotasNegativeTestJSON-980093826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0844684b-8602-44f9-9249-8f2b8ef7a6ba tempest-VolumeQuotasNegativeTestJSON-980093826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:45 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0844684b-8602-44f9-9249-8f2b8ef7a6ba tempest-VolumeQuotasNegativeTestJSON-980093826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:19:45 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0844684b-8602-44f9-9249-8f2b8ef7a6ba tempest-VolumeQuotasNegativeTestJSON-980093826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:19:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0844684b-8602-44f9-9249-8f2b8ef7a6ba tempest-VolumeQuotasNegativeTestJSON-980093826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0844684b-8602-44f9-9249-8f2b8ef7a6ba tempest-VolumeQuotasNegativeTestJSON-980093826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:45 devstack sudo[94515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:19:45 devstack sudo[94515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-bb33384c-a92f-478d-893d-e591c823480e req-03442fb0-08e7-4e14-a5c6-f0111d22e335 tempest-VolumesSnapshotsTestJSON-320302435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-bb33384c-a92f-478d-893d-e591c823480e req-03442fb0-08e7-4e14-a5c6-f0111d22e335 tempest-VolumesSnapshotsTestJSON-320302435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:45 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [req-bb33384c-a92f-478d-893d-e591c823480e req-03442fb0-08e7-4e14-a5c6-f0111d22e335 tempest-VolumesSnapshotsTestJSON-320302435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:19:45 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [req-bb33384c-a92f-478d-893d-e591c823480e req-03442fb0-08e7-4e14-a5c6-f0111d22e335 tempest-VolumesSnapshotsTestJSON-320302435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:19:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-bb33384c-a92f-478d-893d-e591c823480e req-03442fb0-08e7-4e14-a5c6-f0111d22e335 tempest-VolumesSnapshotsTestJSON-320302435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-bb33384c-a92f-478d-893d-e591c823480e req-03442fb0-08e7-4e14-a5c6-f0111d22e335 tempest-VolumesSnapshotsTestJSON-320302435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:45 devstack sudo[94517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:19:45 devstack sudo[94517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:46 devstack sudo[94515]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0844684b-8602-44f9-9249-8f2b8ef7a6ba tempest-VolumeQuotasNegativeTestJSON-980093826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.587s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:46 devstack sudo[94517]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:46 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-0844684b-8602-44f9-9249-8f2b8ef7a6ba tempest-VolumeQuotasNegativeTestJSON-980093826 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:19:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-bb33384c-a92f-478d-893d-e591c823480e req-03442fb0-08e7-4e14-a5c6-f0111d22e335 tempest-VolumesSnapshotsTestJSON-320302435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.530s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:46 devstack cinder-volume[86801]: DEBUG cinder.manager [req-bb33384c-a92f-478d-893d-e591c823480e req-03442fb0-08e7-4e14-a5c6-f0111d22e335 tempest-VolumesSnapshotsTestJSON-320302435 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:19:46 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-0844684b-8602-44f9-9249-8f2b8ef7a6ba tempest-VolumeQuotasNegativeTestJSON-980093826 None] Deleted volume successfully. Nov 03 08:19:46 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-bb33384c-a92f-478d-893d-e591c823480e req-03442fb0-08e7-4e14-a5c6-f0111d22e335 tempest-VolumesSnapshotsTestJSON-320302435 None] Deleted volume successfully. Nov 03 08:19:46 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0844684b-8602-44f9-9249-8f2b8ef7a6ba tempest-VolumeQuotasNegativeTestJSON-980093826 None] Lock "cinder-a2889f15-80f3-4a7a-8822-61ff37980177-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:19:46 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-bb33384c-a92f-478d-893d-e591c823480e req-03442fb0-08e7-4e14-a5c6-f0111d22e335 tempest-VolumesSnapshotsTestJSON-320302435 None] Lock "cinder-1ec8aebe-a0b9-4cd6-8be6-0b6508cf64bb-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:19:54 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=106,cinder:UPDATE=122,cinder:INSERT=29,cinder:DELETE=8 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:19:54 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=113,cinder:INSERT=33,cinder:UPDATE=129,cinder:DELETE=4 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:19:54 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:19:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Flow 'volume_create_manager' (837075d0-cb4a-4085-b625-db4b6c072905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:19:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5adafb88-3c09-4950-807f-8d43bfbf8c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5adafb88-3c09-4950-807f-8d43bfbf8c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-725428012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1167281-ab78-4c7b-87ca-6044e0f38fa6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='caeb4ac6301148f89e845c81d1d6b9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:54Z,use_quota=True,user_id='cb38a05c2a9543fe94818923c6888e78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da6db80-22fe-4237-8cff-5a6e802b9723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da6db80-22fe-4237-8cff-5a6e802b9723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d7a783-8fa7-4477-97d8-8f3f4d0741dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d7a783-8fa7-4477-97d8-8f3f4d0741dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1167281-ab78-4c7b-87ca-6044e0f38fa6', 'volume_name': 'volume-d1167281-ab78-4c7b-87ca-6044e0f38fa6', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (869f9aea-8c1d-4a13-b91d-cb59d75d2da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (869f9aea-8c1d-4a13-b91d-cb59d75d2da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (465ce6b6-a782-4b2e-b6e9-0ae1ce8a30f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:54 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Volume d1167281-ab78-4c7b-87ca-6044e0f38fa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1167281-ab78-4c7b-87ca-6044e0f38fa6', 'volume_size': 1} Nov 03 08:19:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-725428012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1167281-ab78-4c7b-87ca-6044e0f38fa6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='caeb4ac6301148f89e845c81d1d6b9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:54Z,use_quota=True,user_id='cb38a05c2a9543fe94818923c6888e78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:19:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Creating volume d1167281-ab78-4c7b-87ca-6044e0f38fa6 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:19:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:19:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:19:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:19:54 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:19:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d1167281-ab78-4c7b-87ca-6044e0f38fa6 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:54 devstack sudo[94604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d1167281-ab78-4c7b-87ca-6044e0f38fa6 1073741824 Nov 03 08:19:54 devstack sudo[94604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:54 devstack sudo[94604]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d1167281-ab78-4c7b-87ca-6044e0f38fa6 1073741824" returned: 0 in 0.539s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d1167281-ab78-4c7b-87ca-6044e0f38fa6 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:54 devstack sudo[94610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d1167281-ab78-4c7b-87ca-6044e0f38fa6 Nov 03 08:19:54 devstack sudo[94610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:55 devstack sudo[94610]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d1167281-ab78-4c7b-87ca-6044e0f38fa6" returned: 0 in 0.312s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:55 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:19:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:55 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (465ce6b6-a782-4b2e-b6e9-0ae1ce8a30f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1167281-ab78-4c7b-87ca-6044e0f38fa6', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:55 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe2bf4e-055d-453f-8567-3849d5eba74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:55 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Volume volume-d1167281-ab78-4c7b-87ca-6044e0f38fa6 (d1167281-ab78-4c7b-87ca-6044e0f38fa6): created successfully Nov 03 08:19:55 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe2bf4e-055d-453f-8567-3849d5eba74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:55 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Flow 'volume_create_manager' (837075d0-cb4a-4085-b625-db4b6c072905) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:19:55 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-b9c7dfc5-f093-46d7-bf2d-1a10e78d29bc tempest-VolumesTestJSON-1477069852 None] Created volume successfully. Nov 03 08:19:55 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-26234065-a7cb-4c25-8dee-06c62acf9692 tempest-GroupSnapshotsV319Test-1837458340 None] Group tempest-GroupSnapshotsV319Test-Group-177947788: creating Nov 03 08:19:55 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-26234065-a7cb-4c25-8dee-06c62acf9692 tempest-GroupSnapshotsV319Test-1837458340 None] Group tempest-GroupSnapshotsV319Test-Group-177947788: created successfully Nov 03 08:19:55 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-26234065-a7cb-4c25-8dee-06c62acf9692 tempest-GroupSnapshotsV319Test-1837458340 None] Create group completed successfully. Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Flow 'volume_create_manager' (233bf7cf-0db3-4217-b9d0-267d34258e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a1c48dd-4d07-4fb2-9bcc-7be5a7fab85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a1c48dd-4d07-4fb2-9bcc-7be5a7fab85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1952518448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93fac61b-f94a-47d2-a1eb-04cecd657d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a0caabb99dc45249d67c813a9a961c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:57Z,use_quota=True,user_id='c728a83c8c824696a23d0c1438c5628d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67637ca5-2eac-421c-b69c-a6807f3e6490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67637ca5-2eac-421c-b69c-a6807f3e6490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a73604e-962b-4b99-a51f-4281914dbfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a73604e-962b-4b99-a51f-4281914dbfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93fac61b-f94a-47d2-a1eb-04cecd657d9d', 'volume_name': 'volume-93fac61b-f94a-47d2-a1eb-04cecd657d9d', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4d95bb-0a3f-413f-96b9-7e8a65d86752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4d95bb-0a3f-413f-96b9-7e8a65d86752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d64da67-1966-45c3-93ef-9dcf59b77807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:57 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Volume 93fac61b-f94a-47d2-a1eb-04cecd657d9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93fac61b-f94a-47d2-a1eb-04cecd657d9d', 'volume_size': 1} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1952518448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93fac61b-f94a-47d2-a1eb-04cecd657d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a0caabb99dc45249d67c813a9a961c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:57Z,use_quota=True,user_id='c728a83c8c824696a23d0c1438c5628d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Creating volume 93fac61b-f94a-47d2-a1eb-04cecd657d9d {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:19:57 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-93fac61b-f94a-47d2-a1eb-04cecd657d9d 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:57 devstack sudo[94615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-93fac61b-f94a-47d2-a1eb-04cecd657d9d 1073741824 Nov 03 08:19:57 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Flow 'volume_create_manager' (bdc85be2-236b-45b5-b8ea-e065738be59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b388d9-b1a8-421b-a7b7-f7fe4dd338d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b388d9-b1a8-421b-a7b7-f7fe4dd338d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-307108271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=989b83ac-9bec-4d64-8420-7cd2ed1eac78,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='caeb4ac6301148f89e845c81d1d6b9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:57Z,use_quota=True,user_id='cb38a05c2a9543fe94818923c6888e78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f95906-2e59-4259-b9cf-07b307996066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f95906-2e59-4259-b9cf-07b307996066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98d6b28-3330-4f40-a613-2d3ab95a394e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98d6b28-3330-4f40-a613-2d3ab95a394e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '989b83ac-9bec-4d64-8420-7cd2ed1eac78', 'volume_name': 'volume-989b83ac-9bec-4d64-8420-7cd2ed1eac78', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe44ee6-dd30-4593-ae16-3d3418409918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe44ee6-dd30-4593-ae16-3d3418409918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a85e1276-1d86-4a07-9ac8-7923c2d565d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:57 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Volume 989b83ac-9bec-4d64-8420-7cd2ed1eac78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-989b83ac-9bec-4d64-8420-7cd2ed1eac78', 'volume_size': 1} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Flow 'volume_create_manager' (1d6f7699-c8c1-49ef-b267-9998addbac7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7397c462-7368-4a59-b1c0-3e1a21074005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7397c462-7368-4a59-b1c0-3e1a21074005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1241261740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5239fad6-2b34-490c-a4ea-9f90cccb6897,host='devstack@QuobyteHD#QuobyteHD',id=97376b91-ef4b-4144-be16-d833becda1c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c767b2f5534ce69e2faa92b00b643b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:57Z,use_quota=True,user_id='ec39bcb36bf34907a67b343bb488a515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a16cf3a-494f-498f-8b34-94563e17eb44),volume_type_id=9a16cf3a-494f-498f-8b34-94563e17eb44)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bdaadba-54ca-4ec6-896e-77ae9949d811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bdaadba-54ca-4ec6-896e-77ae9949d811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d3faa0-f65e-4a05-819b-93260a1b1a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d3faa0-f65e-4a05-819b-93260a1b1a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97376b91-ef4b-4144-be16-d833becda1c5', 'volume_name': 'volume-97376b91-ef4b-4144-be16-d833becda1c5', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60189ef3-2dfe-44a3-8a0e-b4296d724d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60189ef3-2dfe-44a3-8a0e-b4296d724d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fdc2135-29fe-44e7-a9fa-1426735728a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:57 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Volume 97376b91-ef4b-4144-be16-d833becda1c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97376b91-ef4b-4144-be16-d833becda1c5', 'volume_size': 1} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:57 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-93fac61b-f94a-47d2-a1eb-04cecd657d9d 1073741824" returned: 0 in 0.577s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-93fac61b-f94a-47d2-a1eb-04cecd657d9d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:57 devstack sudo[94621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-93fac61b-f94a-47d2-a1eb-04cecd657d9d Nov 03 08:19:57 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:58 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-93fac61b-f94a-47d2-a1eb-04cecd657d9d" returned: 0 in 0.262s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.647s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-307108271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=989b83ac-9bec-4d64-8420-7cd2ed1eac78,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='caeb4ac6301148f89e845c81d1d6b9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:57Z,use_quota=True,user_id='cb38a05c2a9543fe94818923c6888e78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Creating volume 989b83ac-9bec-4d64-8420-7cd2ed1eac78 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:19:58 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-989b83ac-9bec-4d64-8420-7cd2ed1eac78 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d64da67-1966-45c3-93ef-9dcf59b77807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93fac61b-f94a-47d2-a1eb-04cecd657d9d', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ac6630-b752-45c6-be9e-cd998b32899d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:58 devstack sudo[94624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-989b83ac-9bec-4d64-8420-7cd2ed1eac78 1073741824 Nov 03 08:19:58 devstack sudo[94624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:58 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Volume volume-93fac61b-f94a-47d2-a1eb-04cecd657d9d (93fac61b-f94a-47d2-a1eb-04cecd657d9d): created successfully Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ac6630-b752-45c6-be9e-cd998b32899d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Flow 'volume_create_manager' (233bf7cf-0db3-4217-b9d0-267d34258e65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:19:58 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-1194491c-79c5-4201-958b-00a9faf17bf9 tempest-AbsoluteLimitsTests-1292079001 None] Created volume successfully. Nov 03 08:19:58 devstack sudo[94624]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-989b83ac-9bec-4d64-8420-7cd2ed1eac78 1073741824" returned: 0 in 0.451s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-989b83ac-9bec-4d64-8420-7cd2ed1eac78 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:58 devstack sudo[94629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-989b83ac-9bec-4d64-8420-7cd2ed1eac78 Nov 03 08:19:58 devstack sudo[94629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:58 devstack sudo[94629]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-989b83ac-9bec-4d64-8420-7cd2ed1eac78" returned: 0 in 0.258s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.253s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5239fad6-2b34-490c-a4ea-9f90cccb6897,created_at=2026-11-03T07:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1241261740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5239fad6-2b34-490c-a4ea-9f90cccb6897,host='devstack@QuobyteHD#QuobyteHD',id=97376b91-ef4b-4144-be16-d833becda1c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c767b2f5534ce69e2faa92b00b643b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:19:57Z,use_quota=True,user_id='ec39bcb36bf34907a67b343bb488a515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a16cf3a-494f-498f-8b34-94563e17eb44),volume_type_id=9a16cf3a-494f-498f-8b34-94563e17eb44)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Creating volume 97376b91-ef4b-4144-be16-d833becda1c5 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:19:58 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a85e1276-1d86-4a07-9ac8-7923c2d565d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-989b83ac-9bec-4d64-8420-7cd2ed1eac78', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:58 devstack sudo[94632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5 1073741824 Nov 03 08:19:58 devstack sudo[94632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a112fee-f170-4bc7-a4f1-1492cf954e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:58 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Volume volume-989b83ac-9bec-4d64-8420-7cd2ed1eac78 (989b83ac-9bec-4d64-8420-7cd2ed1eac78): created successfully Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a112fee-f170-4bc7-a4f1-1492cf954e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:58 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Flow 'volume_create_manager' (bdc85be2-236b-45b5-b8ea-e065738be59a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:19:58 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-4cb96ceb-be4c-4c3b-beda-19754d2a4f22 tempest-VolumesTestJSON-1477069852 None] Created volume successfully. Nov 03 08:19:59 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-96de6acc-46c0-4436-8d43-c1624da1fb6a tempest-AbsoluteLimitsTests-1292079001 None] Acquiring lock "cinder-93fac61b-f94a-47d2-a1eb-04cecd657d9d-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:19:59 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-96de6acc-46c0-4436-8d43-c1624da1fb6a tempest-AbsoluteLimitsTests-1292079001 None] Lock "cinder-93fac61b-f94a-47d2-a1eb-04cecd657d9d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:19:59 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-96de6acc-46c0-4436-8d43-c1624da1fb6a tempest-AbsoluteLimitsTests-1292079001 None] Acquiring lock "cinder-quobyte-93fac61b-f94a-47d2-a1eb-04cecd657d9d" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:19:59 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-96de6acc-46c0-4436-8d43-c1624da1fb6a tempest-AbsoluteLimitsTests-1292079001 None] Lock "cinder-quobyte-93fac61b-f94a-47d2-a1eb-04cecd657d9d" acquired by "delete_volume" :: waited 0.023s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:19:59 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[14af64e5-74fd-4602-ac22-4d58ee244562]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:19:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-96de6acc-46c0-4436-8d43-c1624da1fb6a tempest-AbsoluteLimitsTests-1292079001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-93fac61b-f94a-47d2-a1eb-04cecd657d9d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:59 devstack sudo[94632]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5 1073741824" returned: 0 in 0.557s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:59 devstack sudo[94637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-93fac61b-f94a-47d2-a1eb-04cecd657d9d Nov 03 08:19:59 devstack sudo[94637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:59 devstack sudo[94640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5 Nov 03 08:19:59 devstack sudo[94640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:59 devstack sudo[94640]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5" returned: 0 in 0.278s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:59 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:19:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:19:59 devstack sudo[94637]: pam_unix(sudo:session): session closed for user root Nov 03 08:19:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-96de6acc-46c0-4436-8d43-c1624da1fb6a tempest-AbsoluteLimitsTests-1292079001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-93fac61b-f94a-47d2-a1eb-04cecd657d9d" returned: 0 in 0.416s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:19:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-96de6acc-46c0-4436-8d43-c1624da1fb6a tempest-AbsoluteLimitsTests-1292079001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-93fac61b-f94a-47d2-a1eb-04cecd657d9d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:19:59 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fdc2135-29fe-44e7-a9fa-1426735728a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97376b91-ef4b-4144-be16-d833becda1c5', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:59 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da351901-5cc8-4899-8cb0-480350c11e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:19:59 devstack sudo[94646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-93fac61b-f94a-47d2-a1eb-04cecd657d9d Nov 03 08:19:59 devstack sudo[94646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:19:59 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Volume volume-97376b91-ef4b-4144-be16-d833becda1c5 (97376b91-ef4b-4144-be16-d833becda1c5): created successfully Nov 03 08:19:59 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da351901-5cc8-4899-8cb0-480350c11e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:19:59 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Flow 'volume_create_manager' (1d6f7699-c8c1-49ef-b267-9998addbac7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:19:59 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-c9fe0879-9dd0-4238-9bfd-bda8960756a5 tempest-GroupSnapshotsV319Test-1837458340 None] Created volume successfully. Nov 03 08:20:00 devstack sudo[94646]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-96de6acc-46c0-4436-8d43-c1624da1fb6a tempest-AbsoluteLimitsTests-1292079001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-93fac61b-f94a-47d2-a1eb-04cecd657d9d" returned: 0 in 0.299s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-96de6acc-46c0-4436-8d43-c1624da1fb6a tempest-AbsoluteLimitsTests-1292079001 None] Lock "cinder-quobyte-93fac61b-f94a-47d2-a1eb-04cecd657d9d" released by "delete_volume" :: held 0.767s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-96de6acc-46c0-4436-8d43-c1624da1fb6a tempest-AbsoluteLimitsTests-1292079001 None] Created reservations ['5e3c0bc5-a6b1-48e8-8e77-365dbb974e8e', 'ac41144e-f438-4b21-8981-ae8ca66b5a57', '661de077-3313-4482-8217-ff61425f5c95', 'c4a0ccb2-46b6-4c0f-9e03-ab7d774d1a20'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-96de6acc-46c0-4436-8d43-c1624da1fb6a tempest-AbsoluteLimitsTests-1292079001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-96de6acc-46c0-4436-8d43-c1624da1fb6a tempest-AbsoluteLimitsTests-1292079001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-96de6acc-46c0-4436-8d43-c1624da1fb6a tempest-AbsoluteLimitsTests-1292079001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-96de6acc-46c0-4436-8d43-c1624da1fb6a tempest-AbsoluteLimitsTests-1292079001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-96de6acc-46c0-4436-8d43-c1624da1fb6a tempest-AbsoluteLimitsTests-1292079001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-96de6acc-46c0-4436-8d43-c1624da1fb6a tempest-AbsoluteLimitsTests-1292079001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:00 devstack sudo[94649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:20:00 devstack sudo[94649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:00 devstack sudo[94649]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-96de6acc-46c0-4436-8d43-c1624da1fb6a tempest-AbsoluteLimitsTests-1292079001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.324s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-96de6acc-46c0-4436-8d43-c1624da1fb6a tempest-AbsoluteLimitsTests-1292079001 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:20:00 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-96de6acc-46c0-4436-8d43-c1624da1fb6a tempest-AbsoluteLimitsTests-1292079001 None] Deleted volume successfully. Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-96de6acc-46c0-4436-8d43-c1624da1fb6a tempest-AbsoluteLimitsTests-1292079001 None] Lock "cinder-93fac61b-f94a-47d2-a1eb-04cecd657d9d-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Flow 'volume_create_manager' (af2bb468-b425-461c-8f0c-c65cecb09427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47074747-e746-4e47-a3e4-fa00a7a868e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47074747-e746-4e47-a3e4-fa00a7a868e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-203197726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61b6b0b-a83b-4483-a203-8c055bd0c4af,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='caeb4ac6301148f89e845c81d1d6b9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:01Z,use_quota=True,user_id='cb38a05c2a9543fe94818923c6888e78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe51411b-bdbd-4210-a164-1ddfec3a6edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe51411b-bdbd-4210-a164-1ddfec3a6edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e8c88e-4f6d-411d-a234-bb67f1f53ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e8c88e-4f6d-411d-a234-bb67f1f53ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f61b6b0b-a83b-4483-a203-8c055bd0c4af', 'volume_name': 'volume-f61b6b0b-a83b-4483-a203-8c055bd0c4af', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cecf0f22-7220-4d0f-801d-e30661fb43c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cecf0f22-7220-4d0f-801d-e30661fb43c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7edb5b64-8911-46c5-a743-5040d2ff532e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:00 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Volume f61b6b0b-a83b-4483-a203-8c055bd0c4af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f61b6b0b-a83b-4483-a203-8c055bd0c4af', 'volume_size': 1} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-203197726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61b6b0b-a83b-4483-a203-8c055bd0c4af,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='caeb4ac6301148f89e845c81d1d6b9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:01Z,use_quota=True,user_id='cb38a05c2a9543fe94818923c6888e78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Creating volume f61b6b0b-a83b-4483-a203-8c055bd0c4af {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:20:00 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:20:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f61b6b0b-a83b-4483-a203-8c055bd0c4af 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:00 devstack sudo[94684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f61b6b0b-a83b-4483-a203-8c055bd0c4af 1073741824 Nov 03 08:20:00 devstack sudo[94684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:01 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-ce3ee445-a098-478d-9ac2-dc178c6987bb tempest-GroupSnapshotsV319Test-1837458340 None] GroupSnapshot b409e190-3468-4975-bae2-b5b7462a532c: creating. Nov 03 08:20:01 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ce3ee445-a098-478d-9ac2-dc178c6987bb tempest-GroupSnapshotsV319Test-1837458340 None] Group snapshot b409e190-3468-4975-bae2-b5b7462a532c: creating. {{(pid=86801) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 08:20:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ce3ee445-a098-478d-9ac2-dc178c6987bb tempest-GroupSnapshotsV319Test-1837458340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:01 devstack sudo[94684]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f61b6b0b-a83b-4483-a203-8c055bd0c4af 1073741824" returned: 0 in 0.478s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f61b6b0b-a83b-4483-a203-8c055bd0c4af {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:01 devstack sudo[94690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f61b6b0b-a83b-4483-a203-8c055bd0c4af Nov 03 08:20:01 devstack sudo[94690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:01 devstack sudo[94690]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f61b6b0b-a83b-4483-a203-8c055bd0c4af" returned: 0 in 0.248s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:01 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:20:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ce3ee445-a098-478d-9ac2-dc178c6987bb tempest-GroupSnapshotsV319Test-1837458340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.478s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:01 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7edb5b64-8911-46c5-a743-5040d2ff532e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f61b6b0b-a83b-4483-a203-8c055bd0c4af', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:01 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6213c7ae-078a-4a0a-b762-4016f17d1867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:01 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-ce3ee445-a098-478d-9ac2-dc178c6987bb tempest-GroupSnapshotsV319Test-1837458340 None] Creating offline snapshot 6c983757-1e52-439c-b0d1-0deee5439530 of volume 97376b91-ef4b-4144-be16-d833becda1c5 {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:20:01 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Volume volume-f61b6b0b-a83b-4483-a203-8c055bd0c4af (f61b6b0b-a83b-4483-a203-8c055bd0c4af): created successfully Nov 03 08:20:01 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6213c7ae-078a-4a0a-b762-4016f17d1867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:01 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Flow 'volume_create_manager' (af2bb468-b425-461c-8f0c-c65cecb09427) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:20:01 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[351b22a1-709d-4258-b9b6-faec05371571]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:20:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ce3ee445-a098-478d-9ac2-dc178c6987bb tempest-GroupSnapshotsV319Test-1837458340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:01 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-cca24399-e511-42cc-a1e2-e70879105881 tempest-VolumesTestJSON-1477069852 None] Created volume successfully. Nov 03 08:20:01 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5 Nov 03 08:20:01 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:02 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ce3ee445-a098-478d-9ac2-dc178c6987bb tempest-GroupSnapshotsV319Test-1837458340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5" returned: 0 in 0.432s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ce3ee445-a098-478d-9ac2-dc178c6987bb tempest-GroupSnapshotsV319Test-1837458340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5.6c983757-1e52-439c-b0d1-0deee5439530 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:02 devstack sudo[94734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5.6c983757-1e52-439c-b0d1-0deee5439530 1G Nov 03 08:20:02 devstack sudo[94734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:02 devstack sudo[94734]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ce3ee445-a098-478d-9ac2-dc178c6987bb tempest-GroupSnapshotsV319Test-1837458340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5.6c983757-1e52-439c-b0d1-0deee5439530 1G" returned: 0 in 0.491s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ce3ee445-a098-478d-9ac2-dc178c6987bb tempest-GroupSnapshotsV319Test-1837458340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97376b91-ef4b-4144-be16-d833becda1c5 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5.6c983757-1e52-439c-b0d1-0deee5439530 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:02 devstack sudo[94742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97376b91-ef4b-4144-be16-d833becda1c5 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5.6c983757-1e52-439c-b0d1-0deee5439530 Nov 03 08:20:02 devstack sudo[94742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:03 devstack sudo[94742]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ce3ee445-a098-478d-9ac2-dc178c6987bb tempest-GroupSnapshotsV319Test-1837458340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97376b91-ef4b-4144-be16-d833becda1c5 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5.6c983757-1e52-439c-b0d1-0deee5439530" returned: 0 in 0.329s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:03 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-ce3ee445-a098-478d-9ac2-dc178c6987bb tempest-GroupSnapshotsV319Test-1837458340 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5.6c983757-1e52-439c-b0d1-0deee5439530 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 08:20:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ce3ee445-a098-478d-9ac2-dc178c6987bb tempest-GroupSnapshotsV319Test-1837458340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5.6c983757-1e52-439c-b0d1-0deee5439530 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:03 devstack sudo[94748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5.6c983757-1e52-439c-b0d1-0deee5439530 Nov 03 08:20:03 devstack sudo[94748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:03 devstack sudo[94748]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ce3ee445-a098-478d-9ac2-dc178c6987bb tempest-GroupSnapshotsV319Test-1837458340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5.6c983757-1e52-439c-b0d1-0deee5439530" returned: 0 in 0.268s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ce3ee445-a098-478d-9ac2-dc178c6987bb tempest-GroupSnapshotsV319Test-1837458340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:03 devstack sudo[94751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5.info Nov 03 08:20:03 devstack sudo[94751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:03 devstack sudo[94751]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ce3ee445-a098-478d-9ac2-dc178c6987bb tempest-GroupSnapshotsV319Test-1837458340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5.info" returned: 0 in 0.300s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:03 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-ce3ee445-a098-478d-9ac2-dc178c6987bb tempest-GroupSnapshotsV319Test-1837458340 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 08:20:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ce3ee445-a098-478d-9ac2-dc178c6987bb tempest-GroupSnapshotsV319Test-1837458340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:03 devstack sudo[94754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5.info Nov 03 08:20:03 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:03 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:20:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:03 devstack sudo[94759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:20:03 devstack sudo[94759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:03 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ce3ee445-a098-478d-9ac2-dc178c6987bb tempest-GroupSnapshotsV319Test-1837458340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5.info" returned: 0 in 0.286s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ce3ee445-a098-478d-9ac2-dc178c6987bb tempest-GroupSnapshotsV319Test-1837458340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.259s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:03 devstack sudo[94759]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.285s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:03 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:20:04 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager._thread_info {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:20:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread count: 29 {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 08:20:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread info: [<_MainThread(MainThread, started 139707544170624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 08:20:04 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-ce3ee445-a098-478d-9ac2-dc178c6987bb tempest-GroupSnapshotsV319Test-1837458340 None] group_snapshot b409e190-3468-4975-bae2-b5b7462a532c: created successfully Nov 03 08:20:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5dd32a10-7d00-40e6-b08e-9d8aff106e8b tempest-VolumesTestJSON-1477069852 None] Acquiring lock "cinder-f61b6b0b-a83b-4483-a203-8c055bd0c4af-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:20:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5dd32a10-7d00-40e6-b08e-9d8aff106e8b tempest-VolumesTestJSON-1477069852 None] Lock "cinder-f61b6b0b-a83b-4483-a203-8c055bd0c4af-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:20:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5dd32a10-7d00-40e6-b08e-9d8aff106e8b tempest-VolumesTestJSON-1477069852 None] Acquiring lock "cinder-quobyte-f61b6b0b-a83b-4483-a203-8c055bd0c4af" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:20:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5dd32a10-7d00-40e6-b08e-9d8aff106e8b tempest-VolumesTestJSON-1477069852 None] Lock "cinder-quobyte-f61b6b0b-a83b-4483-a203-8c055bd0c4af" acquired by "delete_volume" :: waited 0.017s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:20:04 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba4a29e-d885-4d27-8a9b-7b5d8e7e3342]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:20:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5dd32a10-7d00-40e6-b08e-9d8aff106e8b tempest-VolumesTestJSON-1477069852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f61b6b0b-a83b-4483-a203-8c055bd0c4af {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:04 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f61b6b0b-a83b-4483-a203-8c055bd0c4af Nov 03 08:20:04 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:04 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5dd32a10-7d00-40e6-b08e-9d8aff106e8b tempest-VolumesTestJSON-1477069852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f61b6b0b-a83b-4483-a203-8c055bd0c4af" returned: 0 in 0.395s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5dd32a10-7d00-40e6-b08e-9d8aff106e8b tempest-VolumesTestJSON-1477069852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f61b6b0b-a83b-4483-a203-8c055bd0c4af {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:04 devstack sudo[94771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f61b6b0b-a83b-4483-a203-8c055bd0c4af Nov 03 08:20:04 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:04 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5dd32a10-7d00-40e6-b08e-9d8aff106e8b tempest-VolumesTestJSON-1477069852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f61b6b0b-a83b-4483-a203-8c055bd0c4af" returned: 0 in 0.275s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5dd32a10-7d00-40e6-b08e-9d8aff106e8b tempest-VolumesTestJSON-1477069852 None] Lock "cinder-quobyte-f61b6b0b-a83b-4483-a203-8c055bd0c4af" released by "delete_volume" :: held 0.723s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:04 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-5dd32a10-7d00-40e6-b08e-9d8aff106e8b tempest-VolumesTestJSON-1477069852 None] Created reservations ['04110b37-cd95-451d-a4ff-9a3763e893b6', '2aed0c13-8827-4965-9915-e46729a1005e', '5ef76749-129f-41c8-8209-c835d4d2f430', '190832ab-74cc-4e60-976d-33c6f9d478bb'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5dd32a10-7d00-40e6-b08e-9d8aff106e8b tempest-VolumesTestJSON-1477069852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5dd32a10-7d00-40e6-b08e-9d8aff106e8b tempest-VolumesTestJSON-1477069852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5dd32a10-7d00-40e6-b08e-9d8aff106e8b tempest-VolumesTestJSON-1477069852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5dd32a10-7d00-40e6-b08e-9d8aff106e8b tempest-VolumesTestJSON-1477069852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5dd32a10-7d00-40e6-b08e-9d8aff106e8b tempest-VolumesTestJSON-1477069852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5dd32a10-7d00-40e6-b08e-9d8aff106e8b tempest-VolumesTestJSON-1477069852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:05 devstack sudo[94774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:20:05 devstack sudo[94774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:05 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-8ea4fbc2-085b-4f99-8934-050565d05059 tempest-GroupSnapshotsV319Test-1837458340 None] group_snapshot b409e190-3468-4975-bae2-b5b7462a532c: deleting Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8ea4fbc2-085b-4f99-8934-050565d05059 tempest-GroupSnapshotsV319Test-1837458340 None] group_snapshot b409e190-3468-4975-bae2-b5b7462a532c: deleting {{(pid=86801) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8ea4fbc2-085b-4f99-8934-050565d05059 tempest-GroupSnapshotsV319Test-1837458340 None] Acquiring lock "cinder-quobyte-97376b91-ef4b-4144-be16-d833becda1c5" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8ea4fbc2-085b-4f99-8934-050565d05059 tempest-GroupSnapshotsV319Test-1837458340 None] Lock "cinder-quobyte-97376b91-ef4b-4144-be16-d833becda1c5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8ea4fbc2-085b-4f99-8934-050565d05059 tempest-GroupSnapshotsV319Test-1837458340 None] Acquiring lock "cinder-quobyte-6c983757-1e52-439c-b0d1-0deee5439530" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8ea4fbc2-085b-4f99-8934-050565d05059 tempest-GroupSnapshotsV319Test-1837458340 None] Lock "cinder-quobyte-6c983757-1e52-439c-b0d1-0deee5439530" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-8ea4fbc2-085b-4f99-8934-050565d05059 tempest-GroupSnapshotsV319Test-1837458340 None] Deleting offline snapshot 6c983757-1e52-439c-b0d1-0deee5439530 of volume 97376b91-ef4b-4144-be16-d833becda1c5 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-8ea4fbc2-085b-4f99-8934-050565d05059 tempest-GroupSnapshotsV319Test-1837458340 None] snapshot_file for this snap is: volume-97376b91-ef4b-4144-be16-d833becda1c5.6c983757-1e52-439c-b0d1-0deee5439530 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f13f659-cbc2-4827-911e-9bee293c854f]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8ea4fbc2-085b-4f99-8934-050565d05059 tempest-GroupSnapshotsV319Test-1837458340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5.6c983757-1e52-439c-b0d1-0deee5439530 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:05 devstack sudo[94774]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5dd32a10-7d00-40e6-b08e-9d8aff106e8b tempest-VolumesTestJSON-1477069852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.342s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-5dd32a10-7d00-40e6-b08e-9d8aff106e8b tempest-VolumesTestJSON-1477069852 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:20:05 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-5dd32a10-7d00-40e6-b08e-9d8aff106e8b tempest-VolumesTestJSON-1477069852 None] Deleted volume successfully. Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5b37cec8-2f92-444a-9e88-f48e15c984c1 tempest-VolumesTestJSON-1477069852 None] Acquiring lock "cinder-989b83ac-9bec-4d64-8420-7cd2ed1eac78-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5dd32a10-7d00-40e6-b08e-9d8aff106e8b tempest-VolumesTestJSON-1477069852 None] Lock "cinder-f61b6b0b-a83b-4483-a203-8c055bd0c4af-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5b37cec8-2f92-444a-9e88-f48e15c984c1 tempest-VolumesTestJSON-1477069852 None] Lock "cinder-989b83ac-9bec-4d64-8420-7cd2ed1eac78-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:20:05 devstack sudo[94777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5.6c983757-1e52-439c-b0d1-0deee5439530 Nov 03 08:20:05 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5b37cec8-2f92-444a-9e88-f48e15c984c1 tempest-VolumesTestJSON-1477069852 None] Acquiring lock "cinder-quobyte-989b83ac-9bec-4d64-8420-7cd2ed1eac78" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5b37cec8-2f92-444a-9e88-f48e15c984c1 tempest-VolumesTestJSON-1477069852 None] Lock "cinder-quobyte-989b83ac-9bec-4d64-8420-7cd2ed1eac78" acquired by "delete_volume" :: waited 0.016s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efa0a09-bfdd-484c-8418-0838ddc4e50d]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b37cec8-2f92-444a-9e88-f48e15c984c1 tempest-VolumesTestJSON-1477069852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-989b83ac-9bec-4d64-8420-7cd2ed1eac78 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:05 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-989b83ac-9bec-4d64-8420-7cd2ed1eac78 Nov 03 08:20:05 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:05 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8ea4fbc2-085b-4f99-8934-050565d05059 tempest-GroupSnapshotsV319Test-1837458340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5.6c983757-1e52-439c-b0d1-0deee5439530" returned: 0 in 0.461s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-8ea4fbc2-085b-4f99-8934-050565d05059 tempest-GroupSnapshotsV319Test-1837458340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97376b91-ef4b-4144-be16-d833becda1c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2e5ee9-a454-46c9-a3c1-e65536689e91]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8ea4fbc2-085b-4f99-8934-050565d05059 tempest-GroupSnapshotsV319Test-1837458340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:05 devstack sudo[94784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5 Nov 03 08:20:05 devstack sudo[94784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:05 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b37cec8-2f92-444a-9e88-f48e15c984c1 tempest-VolumesTestJSON-1477069852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-989b83ac-9bec-4d64-8420-7cd2ed1eac78" returned: 0 in 0.453s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b37cec8-2f92-444a-9e88-f48e15c984c1 tempest-VolumesTestJSON-1477069852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-989b83ac-9bec-4d64-8420-7cd2ed1eac78 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:06 devstack sudo[94790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-989b83ac-9bec-4d64-8420-7cd2ed1eac78 Nov 03 08:20:06 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Flow 'volume_create_manager' (ceb10ada-79e9-4655-bc61-21c3ce5e71e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07b1903-089f-4003-9834-33d2e8db9491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07b1903-089f-4003-9834-33d2e8db9491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1791966989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f93cd8-1c80-4e41-b17c-695a16be4348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b418c3a3c8fe40138732f49b28d9c9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:06Z,use_quota=True,user_id='b925c23677ba4e20b0378bce7516aa01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c26023-228a-42c6-9214-4dbdc8ee5e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c26023-228a-42c6-9214-4dbdc8ee5e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f12778a-7922-480e-8c33-10641d1a7c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f12778a-7922-480e-8c33-10641d1a7c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86f93cd8-1c80-4e41-b17c-695a16be4348', 'volume_name': 'volume-86f93cd8-1c80-4e41-b17c-695a16be4348', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d524366-7b67-4a92-bd7e-b0c7ac0506f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d524366-7b67-4a92-bd7e-b0c7ac0506f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81833d5d-fffb-4fcb-bd97-247131803f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:06 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Volume 86f93cd8-1c80-4e41-b17c-695a16be4348: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86f93cd8-1c80-4e41-b17c-695a16be4348', 'volume_size': 1} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1791966989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f93cd8-1c80-4e41-b17c-695a16be4348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b418c3a3c8fe40138732f49b28d9c9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:06Z,use_quota=True,user_id='b925c23677ba4e20b0378bce7516aa01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Creating volume 86f93cd8-1c80-4e41-b17c-695a16be4348 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:20:06 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-86f93cd8-1c80-4e41-b17c-695a16be4348 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:06 devstack sudo[94795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-86f93cd8-1c80-4e41-b17c-695a16be4348 1073741824 Nov 03 08:20:06 devstack sudo[94795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:06 devstack sudo[94784]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8ea4fbc2-085b-4f99-8934-050565d05059 tempest-GroupSnapshotsV319Test-1837458340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5" returned: 0 in 0.405s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8ea4fbc2-085b-4f99-8934-050565d05059 tempest-GroupSnapshotsV319Test-1837458340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5.6c983757-1e52-439c-b0d1-0deee5439530 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:06 devstack sudo[94798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5.6c983757-1e52-439c-b0d1-0deee5439530 Nov 03 08:20:06 devstack sudo[94798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:06 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b37cec8-2f92-444a-9e88-f48e15c984c1 tempest-VolumesTestJSON-1477069852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-989b83ac-9bec-4d64-8420-7cd2ed1eac78" returned: 0 in 0.269s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5b37cec8-2f92-444a-9e88-f48e15c984c1 tempest-VolumesTestJSON-1477069852 None] Lock "cinder-quobyte-989b83ac-9bec-4d64-8420-7cd2ed1eac78" released by "delete_volume" :: held 0.773s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-5b37cec8-2f92-444a-9e88-f48e15c984c1 tempest-VolumesTestJSON-1477069852 None] Created reservations ['d893cf72-7a42-4f79-9d2a-1cb92e2c1383', '3058e66c-68bb-4066-b1f2-c4cc123ac994', '9523b127-95f4-49d1-bb32-5f2067f810d5', '626ba538-811b-4ea3-8986-3cd1bc753221'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5b37cec8-2f92-444a-9e88-f48e15c984c1 tempest-VolumesTestJSON-1477069852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5b37cec8-2f92-444a-9e88-f48e15c984c1 tempest-VolumesTestJSON-1477069852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5b37cec8-2f92-444a-9e88-f48e15c984c1 tempest-VolumesTestJSON-1477069852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5b37cec8-2f92-444a-9e88-f48e15c984c1 tempest-VolumesTestJSON-1477069852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5b37cec8-2f92-444a-9e88-f48e15c984c1 tempest-VolumesTestJSON-1477069852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b37cec8-2f92-444a-9e88-f48e15c984c1 tempest-VolumesTestJSON-1477069852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:06 devstack sudo[94802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:20:06 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:06 devstack sudo[94798]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8ea4fbc2-085b-4f99-8934-050565d05059 tempest-GroupSnapshotsV319Test-1837458340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5.6c983757-1e52-439c-b0d1-0deee5439530" returned: 0 in 0.381s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8ea4fbc2-085b-4f99-8934-050565d05059 tempest-GroupSnapshotsV319Test-1837458340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5.6c983757-1e52-439c-b0d1-0deee5439530 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a4785139-5318-4864-a4ee-7a86433ad11e tempest-VolumesTestJSON-1477069852 None] Acquiring lock "cinder-d1167281-ab78-4c7b-87ca-6044e0f38fa6-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:20:06 devstack sudo[94809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5.6c983757-1e52-439c-b0d1-0deee5439530 Nov 03 08:20:06 devstack sudo[94809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a4785139-5318-4864-a4ee-7a86433ad11e tempest-VolumesTestJSON-1477069852 None] Lock "cinder-d1167281-ab78-4c7b-87ca-6044e0f38fa6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:20:06 devstack sudo[94795]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-86f93cd8-1c80-4e41-b17c-695a16be4348 1073741824" returned: 0 in 0.544s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a4785139-5318-4864-a4ee-7a86433ad11e tempest-VolumesTestJSON-1477069852 None] Acquiring lock "cinder-quobyte-d1167281-ab78-4c7b-87ca-6044e0f38fa6" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-86f93cd8-1c80-4e41-b17c-695a16be4348 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a4785139-5318-4864-a4ee-7a86433ad11e tempest-VolumesTestJSON-1477069852 None] Lock "cinder-quobyte-d1167281-ab78-4c7b-87ca-6044e0f38fa6" acquired by "delete_volume" :: waited 0.036s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:20:06 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:06 devstack sudo[94812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-86f93cd8-1c80-4e41-b17c-695a16be4348 Nov 03 08:20:06 devstack sudo[94812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b37cec8-2f92-444a-9e88-f48e15c984c1 tempest-VolumesTestJSON-1477069852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.393s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-5b37cec8-2f92-444a-9e88-f48e15c984c1 tempest-VolumesTestJSON-1477069852 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:20:06 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-5b37cec8-2f92-444a-9e88-f48e15c984c1 tempest-VolumesTestJSON-1477069852 None] Deleted volume successfully. Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb398075-0396-4f43-8160-417850dfdd47]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a4785139-5318-4864-a4ee-7a86433ad11e tempest-VolumesTestJSON-1477069852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d1167281-ab78-4c7b-87ca-6044e0f38fa6 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5b37cec8-2f92-444a-9e88-f48e15c984c1 tempest-VolumesTestJSON-1477069852 None] Lock "cinder-989b83ac-9bec-4d64-8420-7cd2ed1eac78-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:06 devstack sudo[94814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d1167281-ab78-4c7b-87ca-6044e0f38fa6 Nov 03 08:20:06 devstack sudo[94814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:06 devstack sudo[94809]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8ea4fbc2-085b-4f99-8934-050565d05059 tempest-GroupSnapshotsV319Test-1837458340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5.6c983757-1e52-439c-b0d1-0deee5439530" returned: 0 in 0.348s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:06 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8ea4fbc2-085b-4f99-8934-050565d05059 tempest-GroupSnapshotsV319Test-1837458340 None] Lock "cinder-quobyte-6c983757-1e52-439c-b0d1-0deee5439530" released by "_delete_snapshot" :: held 1.757s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:07 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8ea4fbc2-085b-4f99-8934-050565d05059 tempest-GroupSnapshotsV319Test-1837458340 None] Lock "cinder-quobyte-97376b91-ef4b-4144-be16-d833becda1c5" released by "delete_snapshot" :: held 1.807s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:07 devstack sudo[94812]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-86f93cd8-1c80-4e41-b17c-695a16be4348" returned: 0 in 0.274s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:07 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:20:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:07 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81833d5d-fffb-4fcb-bd97-247131803f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86f93cd8-1c80-4e41-b17c-695a16be4348', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:07 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5912980b-024c-471b-8e23-4442d2ba8cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:07 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Volume volume-86f93cd8-1c80-4e41-b17c-695a16be4348 (86f93cd8-1c80-4e41-b17c-695a16be4348): created successfully Nov 03 08:20:07 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5912980b-024c-471b-8e23-4442d2ba8cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:07 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Flow 'volume_create_manager' (ceb10ada-79e9-4655-bc61-21c3ce5e71e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:20:07 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-d4c246d8-68a0-4754-b5c8-130739283f31 tempest-VolumesMetadataTest-1029735617 None] Created volume successfully. Nov 03 08:20:07 devstack cinder-volume[86801]: WARNING cinder.quota [None req-8ea4fbc2-085b-4f99-8934-050565d05059 tempest-GroupSnapshotsV319Test-1837458340 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1690921835 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1690921835, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:20:07 devstack cinder-volume[86801]: WARNING cinder.quota [None req-8ea4fbc2-085b-4f99-8934-050565d05059 tempest-GroupSnapshotsV319Test-1837458340 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1690921835 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1690921835, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:20:07 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-8ea4fbc2-085b-4f99-8934-050565d05059 tempest-GroupSnapshotsV319Test-1837458340 None] Created reservations ['37713f91-4a56-4f75-90f5-804746427ae9', '150133ef-14dd-4fb2-bd4d-481c76053a5c', 'ccfa43d6-36d3-4348-8487-a6ea3128bb3c', '5f41abce-11bb-4d2b-9ed1-4016c7939f5e'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:20:07 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-8ea4fbc2-085b-4f99-8934-050565d05059 tempest-GroupSnapshotsV319Test-1837458340 None] group_snapshot b409e190-3468-4975-bae2-b5b7462a532c: deleted successfully Nov 03 08:20:07 devstack sudo[94814]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a4785139-5318-4864-a4ee-7a86433ad11e tempest-VolumesTestJSON-1477069852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d1167281-ab78-4c7b-87ca-6044e0f38fa6" returned: 0 in 0.409s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a4785139-5318-4864-a4ee-7a86433ad11e tempest-VolumesTestJSON-1477069852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d1167281-ab78-4c7b-87ca-6044e0f38fa6 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:07 devstack sudo[94822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d1167281-ab78-4c7b-87ca-6044e0f38fa6 Nov 03 08:20:07 devstack sudo[94822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:07 devstack sudo[94822]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a4785139-5318-4864-a4ee-7a86433ad11e tempest-VolumesTestJSON-1477069852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d1167281-ab78-4c7b-87ca-6044e0f38fa6" returned: 0 in 0.241s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:07 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a4785139-5318-4864-a4ee-7a86433ad11e tempest-VolumesTestJSON-1477069852 None] Lock "cinder-quobyte-d1167281-ab78-4c7b-87ca-6044e0f38fa6" released by "delete_volume" :: held 0.710s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:07 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-a4785139-5318-4864-a4ee-7a86433ad11e tempest-VolumesTestJSON-1477069852 None] Created reservations ['079eafe6-4c11-48d6-aa75-4f244ddb1b24', '18c8cf4d-b0fa-4335-add0-3d0959d5456c', '6724d41c-8d3c-484b-895a-998e210076cd', '1fc6a89e-076c-4350-8fc5-a049a6edad23'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:20:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a4785139-5318-4864-a4ee-7a86433ad11e tempest-VolumesTestJSON-1477069852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a4785139-5318-4864-a4ee-7a86433ad11e tempest-VolumesTestJSON-1477069852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:07 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a4785139-5318-4864-a4ee-7a86433ad11e tempest-VolumesTestJSON-1477069852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:07 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a4785139-5318-4864-a4ee-7a86433ad11e tempest-VolumesTestJSON-1477069852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a4785139-5318-4864-a4ee-7a86433ad11e tempest-VolumesTestJSON-1477069852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a4785139-5318-4864-a4ee-7a86433ad11e tempest-VolumesTestJSON-1477069852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:07 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:20:07 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:07 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-afce4436-eabe-4405-9b55-99e5609dcf86 tempest-GroupSnapshotsV319Test-1837458340 None] Acquiring lock "cinder-quobyte-97376b91-ef4b-4144-be16-d833becda1c5" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:20:07 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-afce4436-eabe-4405-9b55-99e5609dcf86 tempest-GroupSnapshotsV319Test-1837458340 None] Lock "cinder-quobyte-97376b91-ef4b-4144-be16-d833becda1c5" acquired by "delete_volume" :: waited 0.021s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:20:07 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a4785139-5318-4864-a4ee-7a86433ad11e tempest-VolumesTestJSON-1477069852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.266s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:07 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-a4785139-5318-4864-a4ee-7a86433ad11e tempest-VolumesTestJSON-1477069852 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:20:07 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-a4785139-5318-4864-a4ee-7a86433ad11e tempest-VolumesTestJSON-1477069852 None] Deleted volume successfully. Nov 03 08:20:07 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe5e845-9ffd-42b2-acdb-eedea2ab0a93]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:20:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-afce4436-eabe-4405-9b55-99e5609dcf86 tempest-GroupSnapshotsV319Test-1837458340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:07 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a4785139-5318-4864-a4ee-7a86433ad11e tempest-VolumesTestJSON-1477069852 None] Lock "cinder-d1167281-ab78-4c7b-87ca-6044e0f38fa6-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:08 devstack sudo[94828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5 Nov 03 08:20:08 devstack sudo[94828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:08 devstack sudo[94828]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-afce4436-eabe-4405-9b55-99e5609dcf86 tempest-GroupSnapshotsV319Test-1837458340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5" returned: 0 in 0.427s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-afce4436-eabe-4405-9b55-99e5609dcf86 tempest-GroupSnapshotsV319Test-1837458340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:08 devstack sudo[94833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5 Nov 03 08:20:08 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:08 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-afce4436-eabe-4405-9b55-99e5609dcf86 tempest-GroupSnapshotsV319Test-1837458340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97376b91-ef4b-4144-be16-d833becda1c5" returned: 0 in 0.272s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:08 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-afce4436-eabe-4405-9b55-99e5609dcf86 tempest-GroupSnapshotsV319Test-1837458340 None] Lock "cinder-quobyte-97376b91-ef4b-4144-be16-d833becda1c5" released by "delete_volume" :: held 0.801s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:08 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-afce4436-eabe-4405-9b55-99e5609dcf86 tempest-GroupSnapshotsV319Test-1837458340 None] Created reservations ['e4fb7d8f-98ce-46a6-aad1-9a61125086c0'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:20:08 devstack cinder-volume[86801]: WARNING cinder.quota [None req-afce4436-eabe-4405-9b55-99e5609dcf86 tempest-GroupSnapshotsV319Test-1837458340 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1690921835 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1690921835, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:20:08 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-afce4436-eabe-4405-9b55-99e5609dcf86 tempest-GroupSnapshotsV319Test-1837458340 None] Created reservations ['b34c82a0-35c5-4288-8051-4f1a083c2bed', '7be9e5b9-1d1d-44d8-9174-6b1550d217d3', '9aed298a-30f0-4c19-b00d-4e0027e56747', '300598d7-1481-4d5b-bf43-65705ff62124'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:20:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-afce4436-eabe-4405-9b55-99e5609dcf86 tempest-GroupSnapshotsV319Test-1837458340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-afce4436-eabe-4405-9b55-99e5609dcf86 tempest-GroupSnapshotsV319Test-1837458340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:08 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-afce4436-eabe-4405-9b55-99e5609dcf86 tempest-GroupSnapshotsV319Test-1837458340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:08 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-afce4436-eabe-4405-9b55-99e5609dcf86 tempest-GroupSnapshotsV319Test-1837458340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-afce4436-eabe-4405-9b55-99e5609dcf86 tempest-GroupSnapshotsV319Test-1837458340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-afce4436-eabe-4405-9b55-99e5609dcf86 tempest-GroupSnapshotsV319Test-1837458340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:08 devstack sudo[94836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:20:08 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:09 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-afce4436-eabe-4405-9b55-99e5609dcf86 tempest-GroupSnapshotsV319Test-1837458340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.343s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:09 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-afce4436-eabe-4405-9b55-99e5609dcf86 tempest-GroupSnapshotsV319Test-1837458340 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:20:09 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-afce4436-eabe-4405-9b55-99e5609dcf86 tempest-GroupSnapshotsV319Test-1837458340 None] Delete group completed successfully. Nov 03 08:20:09 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a0faf3ab-6545-49b6-be1d-a52626d2c977 tempest-VolumesMetadataTest-1029735617 None] Acquiring lock "cinder-86f93cd8-1c80-4e41-b17c-695a16be4348-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:20:09 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a0faf3ab-6545-49b6-be1d-a52626d2c977 tempest-VolumesMetadataTest-1029735617 None] Lock "cinder-86f93cd8-1c80-4e41-b17c-695a16be4348-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:20:09 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a0faf3ab-6545-49b6-be1d-a52626d2c977 tempest-VolumesMetadataTest-1029735617 None] Acquiring lock "cinder-quobyte-86f93cd8-1c80-4e41-b17c-695a16be4348" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:20:09 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a0faf3ab-6545-49b6-be1d-a52626d2c977 tempest-VolumesMetadataTest-1029735617 None] Lock "cinder-quobyte-86f93cd8-1c80-4e41-b17c-695a16be4348" acquired by "delete_volume" :: waited 0.037s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:20:09 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bb1cb9-3090-4e96-a65d-0e20b3900bc6]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:20:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a0faf3ab-6545-49b6-be1d-a52626d2c977 tempest-VolumesMetadataTest-1029735617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-86f93cd8-1c80-4e41-b17c-695a16be4348 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:09 devstack sudo[94840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-86f93cd8-1c80-4e41-b17c-695a16be4348 Nov 03 08:20:09 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:10 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a0faf3ab-6545-49b6-be1d-a52626d2c977 tempest-VolumesMetadataTest-1029735617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-86f93cd8-1c80-4e41-b17c-695a16be4348" returned: 0 in 0.499s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a0faf3ab-6545-49b6-be1d-a52626d2c977 tempest-VolumesMetadataTest-1029735617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-86f93cd8-1c80-4e41-b17c-695a16be4348 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:10 devstack sudo[94845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-86f93cd8-1c80-4e41-b17c-695a16be4348 Nov 03 08:20:10 devstack sudo[94845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:10 devstack sudo[94845]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a0faf3ab-6545-49b6-be1d-a52626d2c977 tempest-VolumesMetadataTest-1029735617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-86f93cd8-1c80-4e41-b17c-695a16be4348" returned: 0 in 0.322s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:10 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a0faf3ab-6545-49b6-be1d-a52626d2c977 tempest-VolumesMetadataTest-1029735617 None] Lock "cinder-quobyte-86f93cd8-1c80-4e41-b17c-695a16be4348" released by "delete_volume" :: held 0.892s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:10 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-a0faf3ab-6545-49b6-be1d-a52626d2c977 tempest-VolumesMetadataTest-1029735617 None] Created reservations ['7104a7ca-0da1-457d-8abd-9abee8b43ff1', 'ba7f9b77-ff06-4558-9e2a-6ad70ea8d0f9', '7c184f79-d12e-4ced-aa79-ac6857ea2f0f', '09b2170d-1a4b-46e6-a880-81258b9b519c'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:20:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a0faf3ab-6545-49b6-be1d-a52626d2c977 tempest-VolumesMetadataTest-1029735617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a0faf3ab-6545-49b6-be1d-a52626d2c977 tempest-VolumesMetadataTest-1029735617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:10 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a0faf3ab-6545-49b6-be1d-a52626d2c977 tempest-VolumesMetadataTest-1029735617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:10 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a0faf3ab-6545-49b6-be1d-a52626d2c977 tempest-VolumesMetadataTest-1029735617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a0faf3ab-6545-49b6-be1d-a52626d2c977 tempest-VolumesMetadataTest-1029735617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a0faf3ab-6545-49b6-be1d-a52626d2c977 tempest-VolumesMetadataTest-1029735617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:10 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:20:10 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:11 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a0faf3ab-6545-49b6-be1d-a52626d2c977 tempest-VolumesMetadataTest-1029735617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.279s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:11 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-a0faf3ab-6545-49b6-be1d-a52626d2c977 tempest-VolumesMetadataTest-1029735617 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:20:11 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-a0faf3ab-6545-49b6-be1d-a52626d2c977 tempest-VolumesMetadataTest-1029735617 None] Deleted volume successfully. Nov 03 08:20:11 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a0faf3ab-6545-49b6-be1d-a52626d2c977 tempest-VolumesMetadataTest-1029735617 None] Lock "cinder-86f93cd8-1c80-4e41-b17c-695a16be4348-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:13 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:20:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Flow 'volume_create_manager' (c28b43be-a843-4c12-a64c-209dea21b0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:20:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c98bf6dc-0a5b-4c77-8a0a-c3543b380210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c98bf6dc-0a5b-4c77-8a0a-c3543b380210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1300908805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4bdb24f-226c-4849-b663-3f2c6faf3260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af19262e4f3a447e93cf24682613a39f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:13Z,use_quota=True,user_id='1655eec14a10467c8f5225f2e985c5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d706c3f-257f-4777-a69b-10e1394981da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d706c3f-257f-4777-a69b-10e1394981da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7cfa7d-0713-4828-88ab-14de3f9cae85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7cfa7d-0713-4828-88ab-14de3f9cae85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4bdb24f-226c-4849-b663-3f2c6faf3260', 'volume_name': 'volume-b4bdb24f-226c-4849-b663-3f2c6faf3260', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb2bdb83-0641-43d2-b979-a98c9991ffc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb2bdb83-0641-43d2-b979-a98c9991ffc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7069c5b3-dd42-456d-83f1-97a10c9a61f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:13 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Volume b4bdb24f-226c-4849-b663-3f2c6faf3260: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4bdb24f-226c-4849-b663-3f2c6faf3260', 'volume_size': 1} Nov 03 08:20:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:13 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1300908805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4bdb24f-226c-4849-b663-3f2c6faf3260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af19262e4f3a447e93cf24682613a39f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:13Z,use_quota=True,user_id='1655eec14a10467c8f5225f2e985c5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:20:13 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Creating volume b4bdb24f-226c-4849-b663-3f2c6faf3260 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:20:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:13 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:13 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:13 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:20:13 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:20:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b4bdb24f-226c-4849-b663-3f2c6faf3260 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:13 devstack sudo[94853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b4bdb24f-226c-4849-b663-3f2c6faf3260 1073741824 Nov 03 08:20:13 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:14 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b4bdb24f-226c-4849-b663-3f2c6faf3260 1073741824" returned: 0 in 0.503s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b4bdb24f-226c-4849-b663-3f2c6faf3260 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:14 devstack sudo[94859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b4bdb24f-226c-4849-b663-3f2c6faf3260 Nov 03 08:20:14 devstack sudo[94859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c3a33228-c902-4d9a-998f-5dc3b591e5f0 tempest-BackendsCapabilitiesAdminTestsJSON-787805294 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6987686157227, 'free_capacity_gb': 1773.6987686157227, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86801) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 08:20:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c30a2065-e8d9-440a-8d7b-fbefd0d222eb tempest-BackendsCapabilitiesAdminTestsJSON-787805294 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6987686157227, 'free_capacity_gb': 1773.6987686157227, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86801) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 08:20:14 devstack sudo[94859]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b4bdb24f-226c-4849-b663-3f2c6faf3260" returned: 0 in 0.335s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:14 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:20:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7069c5b3-dd42-456d-83f1-97a10c9a61f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4bdb24f-226c-4849-b663-3f2c6faf3260', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be6b9a8-1a77-4b62-b8d9-35f2a3598d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:14 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Volume volume-b4bdb24f-226c-4849-b663-3f2c6faf3260 (b4bdb24f-226c-4849-b663-3f2c6faf3260): created successfully Nov 03 08:20:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be6b9a8-1a77-4b62-b8d9-35f2a3598d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Flow 'volume_create_manager' (c28b43be-a843-4c12-a64c-209dea21b0d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:20:14 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-28ff57de-95e5-47b4-8ff0-11d1371af283 tempest-AttachVolumeTestJSON-615484012 None] Created volume successfully. Nov 03 08:20:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-3df2585f-476d-41c6-980f-058e18bbd51a req-f4ba154c-cbc3-4bb9-bd4f-03fa408f98fc tempest-AttachVolumeTestJSON-615484012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-3df2585f-476d-41c6-980f-058e18bbd51a req-f4ba154c-cbc3-4bb9-bd4f-03fa408f98fc tempest-AttachVolumeTestJSON-615484012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-3df2585f-476d-41c6-980f-058e18bbd51a req-f4ba154c-cbc3-4bb9-bd4f-03fa408f98fc tempest-AttachVolumeTestJSON-615484012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-3df2585f-476d-41c6-980f-058e18bbd51a req-f4ba154c-cbc3-4bb9-bd4f-03fa408f98fc tempest-AttachVolumeTestJSON-615484012 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f', 'name': 'volume-b4bdb24f-226c-4849-b663-3f2c6faf3260', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8917a9cc-7d56-4400-8470-4a95f571c6b6', 'enforce_multipath': True} {{(pid=86801) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 08:20:16 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-3df2585f-476d-41c6-980f-058e18bbd51a req-f4ba154c-cbc3-4bb9-bd4f-03fa408f98fc tempest-AttachVolumeTestJSON-615484012 None] attachment_update completed successfully. Nov 03 08:20:17 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-bff802b3-7024-44df-997a-170a9bd40d09 tempest-GroupsV314Test-800647125 None] Group tempest-GroupsV314Test-Group-1373449815: creating Nov 03 08:20:18 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-bff802b3-7024-44df-997a-170a9bd40d09 tempest-GroupsV314Test-800647125 None] Group tempest-GroupsV314Test-Group-1373449815: created successfully Nov 03 08:20:18 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-bff802b3-7024-44df-997a-170a9bd40d09 tempest-GroupsV314Test-800647125 None] Create group completed successfully. Nov 03 08:20:18 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:20:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Flow 'volume_create_manager' (bc4b49a8-b7ac-41a7-98f7-825488c6e60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:20:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98a9235-2af2-468d-a57c-9f786b08464c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98a9235-2af2-468d-a57c-9f786b08464c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1179854977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea47718-4df2-489b-b10f-9568083a57bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9406126b1cf847349c800bad85613de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:18Z,use_quota=True,user_id='82c5c7446a28466ab2fcda00f7599b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0bd6cd-eb80-4cbb-8c4d-645ab5e64fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0bd6cd-eb80-4cbb-8c4d-645ab5e64fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb34abe-a1a6-4da2-9c45-be33be5c761b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb34abe-a1a6-4da2-9c45-be33be5c761b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bea47718-4df2-489b-b10f-9568083a57bb', 'volume_name': 'volume-bea47718-4df2-489b-b10f-9568083a57bb', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a872eae-e8ab-477e-a89d-b93542c185dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a872eae-e8ab-477e-a89d-b93542c185dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0996ca6-0ce6-4032-9e88-b295d91e0844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:18 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Volume bea47718-4df2-489b-b10f-9568083a57bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bea47718-4df2-489b-b10f-9568083a57bb', 'volume_size': 1} Nov 03 08:20:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:18 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1179854977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea47718-4df2-489b-b10f-9568083a57bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9406126b1cf847349c800bad85613de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:18Z,use_quota=True,user_id='82c5c7446a28466ab2fcda00f7599b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:20:18 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Creating volume bea47718-4df2-489b-b10f-9568083a57bb {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:20:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:18 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:18 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:18 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:20:18 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:20:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bea47718-4df2-489b-b10f-9568083a57bb 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:18 devstack sudo[95290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bea47718-4df2-489b-b10f-9568083a57bb 1073741824 Nov 03 08:20:18 devstack sudo[95290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:18 devstack sudo[95290]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bea47718-4df2-489b-b10f-9568083a57bb 1073741824" returned: 0 in 0.513s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bea47718-4df2-489b-b10f-9568083a57bb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:19 devstack sudo[95296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bea47718-4df2-489b-b10f-9568083a57bb Nov 03 08:20:19 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Flow 'volume_create_manager' (69ae21cf-fd31-4039-be59-8d8e9d7b2a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (941e18a3-bc13-465b-88c8-81ab6b1a6f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (941e18a3-bc13-465b-88c8-81ab6b1a6f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1978080898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38c77d25-972b-46a1-b3ae-852471ebab87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af19262e4f3a447e93cf24682613a39f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:19Z,use_quota=True,user_id='1655eec14a10467c8f5225f2e985c5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a826be83-918e-4846-9d1c-912dab9cfdc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a826be83-918e-4846-9d1c-912dab9cfdc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc794fe-6594-4913-bd06-7574678ff7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc794fe-6594-4913-bd06-7574678ff7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38c77d25-972b-46a1-b3ae-852471ebab87', 'volume_name': 'volume-38c77d25-972b-46a1-b3ae-852471ebab87', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09995fa3-e589-419c-80bd-19f3aad93365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09995fa3-e589-419c-80bd-19f3aad93365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d0fbaa5-704e-48d4-8aad-3e05a670a639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:19 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Volume 38c77d25-972b-46a1-b3ae-852471ebab87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38c77d25-972b-46a1-b3ae-852471ebab87', 'volume_size': 1} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:19 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bea47718-4df2-489b-b10f-9568083a57bb" returned: 0 in 0.308s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.111s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1978080898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38c77d25-972b-46a1-b3ae-852471ebab87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af19262e4f3a447e93cf24682613a39f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:19Z,use_quota=True,user_id='1655eec14a10467c8f5225f2e985c5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Creating volume 38c77d25-972b-46a1-b3ae-852471ebab87 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:20:19 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-38c77d25-972b-46a1-b3ae-852471ebab87 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0996ca6-0ce6-4032-9e88-b295d91e0844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bea47718-4df2-489b-b10f-9568083a57bb', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88625d88-1bce-45a5-98af-f9d11dc928d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:19 devstack sudo[95299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-38c77d25-972b-46a1-b3ae-852471ebab87 1073741824 Nov 03 08:20:19 devstack sudo[95299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:19 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Volume volume-bea47718-4df2-489b-b10f-9568083a57bb (bea47718-4df2-489b-b10f-9568083a57bb): created successfully Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88625d88-1bce-45a5-98af-f9d11dc928d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Flow 'volume_create_manager' (bc4b49a8-b7ac-41a7-98f7-825488c6e60b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:20:19 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-1dc09f8b-64c7-461e-b826-70eb877fb5a0 tempest-VolumesTransfersV355Test-1836429532 None] Created volume successfully. Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Flow 'volume_create_manager' (0577ea45-9e76-45ee-808d-bc5645c5cb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24684ae6-c5a9-411b-807d-03073a118900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24684ae6-c5a9-411b-807d-03073a118900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1992228797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d2e4a71-f339-4ebf-8853-4ee9d8f19d20,host='devstack@QuobyteHD#QuobyteHD',id=c4737989-f4f1-48ed-863d-da703b0db6c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b54a5d9974914499b1d6b2f6b754197b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:20Z,use_quota=True,user_id='f57fcc0f20af4d589ebed08ead802531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14f3e027-3aed-4f53-ad63-e07880fecbee),volume_type_id=14f3e027-3aed-4f53-ad63-e07880fecbee)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e921c1f-c8f5-462e-9071-7f9d94adc678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e921c1f-c8f5-462e-9071-7f9d94adc678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a43d3b-ad8c-4678-9d63-1c84833591b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a43d3b-ad8c-4678-9d63-1c84833591b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4737989-f4f1-48ed-863d-da703b0db6c3', 'volume_name': 'volume-c4737989-f4f1-48ed-863d-da703b0db6c3', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68dc519b-7d77-402c-b6a7-9ed6298989c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68dc519b-7d77-402c-b6a7-9ed6298989c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9e60de-01e5-4b63-bd36-0d531380831b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:19 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Volume c4737989-f4f1-48ed-863d-da703b0db6c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4737989-f4f1-48ed-863d-da703b0db6c3', 'volume_size': 1} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:19 devstack sudo[95299]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-38c77d25-972b-46a1-b3ae-852471ebab87 1073741824" returned: 0 in 0.576s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-38c77d25-972b-46a1-b3ae-852471ebab87 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:19 devstack sudo[95304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-38c77d25-972b-46a1-b3ae-852471ebab87 Nov 03 08:20:19 devstack sudo[95304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:20 devstack sudo[95304]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-38c77d25-972b-46a1-b3ae-852471ebab87" returned: 0 in 0.259s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:20:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.318s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0d2e4a71-f339-4ebf-8853-4ee9d8f19d20,created_at=2026-11-03T07:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1992228797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d2e4a71-f339-4ebf-8853-4ee9d8f19d20,host='devstack@QuobyteHD#QuobyteHD',id=c4737989-f4f1-48ed-863d-da703b0db6c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b54a5d9974914499b1d6b2f6b754197b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:20Z,use_quota=True,user_id='f57fcc0f20af4d589ebed08ead802531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14f3e027-3aed-4f53-ad63-e07880fecbee),volume_type_id=14f3e027-3aed-4f53-ad63-e07880fecbee)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:20:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Creating volume c4737989-f4f1-48ed-863d-da703b0db6c3 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:20:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:20:20 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:20:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d0fbaa5-704e-48d4-8aad-3e05a670a639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38c77d25-972b-46a1-b3ae-852471ebab87', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:20 devstack sudo[95307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3 1073741824 Nov 03 08:20:20 devstack sudo[95307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de853550-47f1-47b5-a884-352a4f8e34c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:20 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Volume volume-38c77d25-972b-46a1-b3ae-852471ebab87 (38c77d25-972b-46a1-b3ae-852471ebab87): created successfully Nov 03 08:20:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de853550-47f1-47b5-a884-352a4f8e34c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Flow 'volume_create_manager' (69ae21cf-fd31-4039-be59-8d8e9d7b2a8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:20:20 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-72b4f16e-dfe7-4601-8555-6c66d9bc7410 tempest-AttachVolumeTestJSON-615484012 None] Created volume successfully. Nov 03 08:20:20 devstack sudo[95307]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3 1073741824" returned: 0 in 0.518s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:20 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3 Nov 03 08:20:20 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:21 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3" returned: 0 in 0.326s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:21 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:20:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9e60de-01e5-4b63-bd36-0d531380831b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4737989-f4f1-48ed-863d-da703b0db6c3', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d968f7b8-76bc-4823-8b07-4e3f34578619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:21 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Volume volume-c4737989-f4f1-48ed-863d-da703b0db6c3 (c4737989-f4f1-48ed-863d-da703b0db6c3): created successfully Nov 03 08:20:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d968f7b8-76bc-4823-8b07-4e3f34578619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Flow 'volume_create_manager' (0577ea45-9e76-45ee-808d-bc5645c5cb1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:20:21 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-8260ae8d-d459-4509-8d7e-032c06faec75 tempest-GroupsV314Test-800647125 None] Created volume successfully. Nov 03 08:20:21 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-0fd18dae-6c8f-49cc-bb7d-940d9f4466a2 tempest-VolumesTransfersV355Test-504593464 None] Transfer volume completed successfully. Nov 03 08:20:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a8f8b107-9b62-4891-bd8f-ac6c72563a4b tempest-VolumesTransfersV355Test-726897585 None] Acquiring lock "cinder-bea47718-4df2-489b-b10f-9568083a57bb-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:20:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a8f8b107-9b62-4891-bd8f-ac6c72563a4b tempest-VolumesTransfersV355Test-726897585 None] Lock "cinder-bea47718-4df2-489b-b10f-9568083a57bb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:20:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a8f8b107-9b62-4891-bd8f-ac6c72563a4b tempest-VolumesTransfersV355Test-726897585 None] Acquiring lock "cinder-quobyte-bea47718-4df2-489b-b10f-9568083a57bb" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:20:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a8f8b107-9b62-4891-bd8f-ac6c72563a4b tempest-VolumesTransfersV355Test-726897585 None] Lock "cinder-quobyte-bea47718-4df2-489b-b10f-9568083a57bb" acquired by "delete_volume" :: waited 0.019s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:20:22 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ff7a45-8b90-4669-82b1-104bd1d378dd]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:20:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a8f8b107-9b62-4891-bd8f-ac6c72563a4b tempest-VolumesTransfersV355Test-726897585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bea47718-4df2-489b-b10f-9568083a57bb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:22 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-4d8f2b32-2532-47f7-98fc-b79155be1e40 tempest-GroupsTest-868371497 None] Group tempest-Group1-1648340144: creating Nov 03 08:20:22 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-4d8f2b32-2532-47f7-98fc-b79155be1e40 tempest-GroupsTest-868371497 None] Group tempest-Group1-1648340144: created successfully Nov 03 08:20:22 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-4d8f2b32-2532-47f7-98fc-b79155be1e40 tempest-GroupsTest-868371497 None] Create group completed successfully. Nov 03 08:20:22 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bea47718-4df2-489b-b10f-9568083a57bb Nov 03 08:20:22 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:22 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-a66f33fa-16ad-46aa-89d4-5838c06a51e6 tempest-GroupsTest-868371497 None] Group tempest-Group2-136130861: creating Nov 03 08:20:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-62546a5b-c2e5-4af1-bb1f-2600be7110ea req-d23fbfd7-0247-4d18-840a-063dfe86f713 tempest-AttachVolumeTestJSON-615484012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-62546a5b-c2e5-4af1-bb1f-2600be7110ea req-d23fbfd7-0247-4d18-840a-063dfe86f713 tempest-AttachVolumeTestJSON-615484012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-62546a5b-c2e5-4af1-bb1f-2600be7110ea req-d23fbfd7-0247-4d18-840a-063dfe86f713 tempest-AttachVolumeTestJSON-615484012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:22 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-a66f33fa-16ad-46aa-89d4-5838c06a51e6 tempest-GroupsTest-868371497 None] Group tempest-Group2-136130861: created successfully Nov 03 08:20:22 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-a66f33fa-16ad-46aa-89d4-5838c06a51e6 tempest-GroupsTest-868371497 None] Create group completed successfully. Nov 03 08:20:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-62546a5b-c2e5-4af1-bb1f-2600be7110ea req-d23fbfd7-0247-4d18-840a-063dfe86f713 tempest-AttachVolumeTestJSON-615484012 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f', 'name': 'volume-38c77d25-972b-46a1-b3ae-852471ebab87', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '80a5369d-deb1-42fc-ba1a-9923a95d1f9d', 'enforce_multipath': True} {{(pid=86801) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 08:20:22 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a8f8b107-9b62-4891-bd8f-ac6c72563a4b tempest-VolumesTransfersV355Test-726897585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bea47718-4df2-489b-b10f-9568083a57bb" returned: 0 in 0.477s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a8f8b107-9b62-4891-bd8f-ac6c72563a4b tempest-VolumesTransfersV355Test-726897585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bea47718-4df2-489b-b10f-9568083a57bb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:22 devstack sudo[95332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bea47718-4df2-489b-b10f-9568083a57bb Nov 03 08:20:22 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:22 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-62546a5b-c2e5-4af1-bb1f-2600be7110ea req-d23fbfd7-0247-4d18-840a-063dfe86f713 tempest-AttachVolumeTestJSON-615484012 None] attachment_update completed successfully. Nov 03 08:20:22 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a8f8b107-9b62-4891-bd8f-ac6c72563a4b tempest-VolumesTransfersV355Test-726897585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bea47718-4df2-489b-b10f-9568083a57bb" returned: 0 in 0.291s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a8f8b107-9b62-4891-bd8f-ac6c72563a4b tempest-VolumesTransfersV355Test-726897585 None] Lock "cinder-quobyte-bea47718-4df2-489b-b10f-9568083a57bb" released by "delete_volume" :: held 0.826s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-a8f8b107-9b62-4891-bd8f-ac6c72563a4b tempest-VolumesTransfersV355Test-726897585 None] Created reservations ['325cee28-9d86-4e60-9397-27a0d7ce8db5', '5a37926b-5af7-4979-bff1-69310d67b584', '1f1d19bd-0460-4eaa-b3b1-ca2dd9aa20dc', 'd6b4456c-8c0e-4dd9-91d1-0912c30cf5cf'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:23 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Cloning volume c4737989-f4f1-48ed-863d-da703b0db6c3 to volume 398ae50b-9bdc-4d01-83db-97f2f18aed33 Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Creating offline snapshot 342676ca-caab-4246-ba70-3bf4b75be45d of volume c4737989-f4f1-48ed-863d-da703b0db6c3 {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec6e3ee-5055-46dd-a5ef-8f189f4b0df9]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a8f8b107-9b62-4891-bd8f-ac6c72563a4b tempest-VolumesTransfersV355Test-726897585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a8f8b107-9b62-4891-bd8f-ac6c72563a4b tempest-VolumesTransfersV355Test-726897585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a8f8b107-9b62-4891-bd8f-ac6c72563a4b tempest-VolumesTransfersV355Test-726897585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a8f8b107-9b62-4891-bd8f-ac6c72563a4b tempest-VolumesTransfersV355Test-726897585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a8f8b107-9b62-4891-bd8f-ac6c72563a4b tempest-VolumesTransfersV355Test-726897585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a8f8b107-9b62-4891-bd8f-ac6c72563a4b tempest-VolumesTransfersV355Test-726897585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:23 devstack sudo[95339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:20:23 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:23 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3 Nov 03 08:20:23 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:23 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a8f8b107-9b62-4891-bd8f-ac6c72563a4b tempest-VolumesTransfersV355Test-726897585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.329s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-a8f8b107-9b62-4891-bd8f-ac6c72563a4b tempest-VolumesTransfersV355Test-726897585 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:20:23 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-a8f8b107-9b62-4891-bd8f-ac6c72563a4b tempest-VolumesTransfersV355Test-726897585 None] Deleted volume successfully. Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a8f8b107-9b62-4891-bd8f-ac6c72563a4b tempest-VolumesTransfersV355Test-726897585 None] Lock "cinder-bea47718-4df2-489b-b10f-9568083a57bb-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Flow 'volume_create_manager' (428a643e-e945-4f7e-ae74-22b151fcbbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80719fac-dedc-4fba-b5e1-413e9583d840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80719fac-dedc-4fba-b5e1-413e9583d840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-941070485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2c2c3dfe-823e-44cd-9a26-d32b38fe0ecf,host='devstack@QuobyteHD#QuobyteHD',id=ee839823-ba56-420f-8f43-39bba8615b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46da085ba503402ab6dbfab4ed93d4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:24Z,use_quota=True,user_id='4d5c0edfd44841f69beb5556cde9e7c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c8d47ce-686e-478e-8b6b-2cf06d8803a1),volume_type_id=0c8d47ce-686e-478e-8b6b-2cf06d8803a1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf05a124-7382-4628-827d-a45da7dd3147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:23 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf05a124-7382-4628-827d-a45da7dd3147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a1bacf-1706-498c-ae54-17f4cc324f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a1bacf-1706-498c-ae54-17f4cc324f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee839823-ba56-420f-8f43-39bba8615b80', 'volume_name': 'volume-ee839823-ba56-420f-8f43-39bba8615b80', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b75e937-3611-44b1-a05e-64d82a30d26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b75e937-3611-44b1-a05e-64d82a30d26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd6739b1-2e47-4c0c-ba8a-0473baf4bdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:23 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Volume ee839823-ba56-420f-8f43-39bba8615b80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee839823-ba56-420f-8f43-39bba8615b80', 'volume_size': 1} Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3" returned: 0 in 0.574s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.342676ca-caab-4246-ba70-3bf4b75be45d 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:23 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.342676ca-caab-4246-ba70-3bf4b75be45d 1G Nov 03 08:20:23 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:24 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.342676ca-caab-4246-ba70-3bf4b75be45d 1G" returned: 0 in 0.467s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4737989-f4f1-48ed-863d-da703b0db6c3 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.342676ca-caab-4246-ba70-3bf4b75be45d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:24 devstack sudo[95352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4737989-f4f1-48ed-863d-da703b0db6c3 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.342676ca-caab-4246-ba70-3bf4b75be45d Nov 03 08:20:24 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:24 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:20:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Flow 'volume_create_manager' (96e4b94e-b494-4dce-b1a4-2b189fc31360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:20:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61a6d03-976d-4102-9168-c3aa3d7f6d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61a6d03-976d-4102-9168-c3aa3d7f6d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1635737851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97007ad5-4102-456e-ba9d-6ecf018e672b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9406126b1cf847349c800bad85613de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:24Z,use_quota=True,user_id='82c5c7446a28466ab2fcda00f7599b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e51cdc6-461a-40cb-aecc-79f33955ffcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e51cdc6-461a-40cb-aecc-79f33955ffcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18bcebb4-f25f-4447-b545-2bcc96c15541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18bcebb4-f25f-4447-b545-2bcc96c15541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97007ad5-4102-456e-ba9d-6ecf018e672b', 'volume_name': 'volume-97007ad5-4102-456e-ba9d-6ecf018e672b', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaf4d72a-c5a7-402b-a20c-a527cb26fbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaf4d72a-c5a7-402b-a20c-a527cb26fbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92aea69-6e2c-4524-ad88-39453e971fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:24 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Volume 97007ad5-4102-456e-ba9d-6ecf018e672b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97007ad5-4102-456e-ba9d-6ecf018e672b', 'volume_size': 1} Nov 03 08:20:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:24 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4737989-f4f1-48ed-863d-da703b0db6c3 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.342676ca-caab-4246-ba70-3bf4b75be45d" returned: 0 in 0.296s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:24 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.342676ca-caab-4246-ba70-3bf4b75be45d is being set with open permissions: ugo+rw: NotImplementedError Nov 03 08:20:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.342676ca-caab-4246-ba70-3bf4b75be45d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:24 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.342676ca-caab-4246-ba70-3bf4b75be45d Nov 03 08:20:24 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:24 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.342676ca-caab-4246-ba70-3bf4b75be45d" returned: 0 in 0.265s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:24 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.info Nov 03 08:20:24 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:25 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.info" returned: 0 in 0.270s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:25 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 08:20:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:25 devstack sudo[95365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.info Nov 03 08:20:25 devstack sudo[95365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:25 devstack sudo[95365]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.info" returned: 0 in 0.252s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Acquiring lock "cinder-quobyte-398ae50b-9bdc-4d01-83db-97f2f18aed33" by "_copy_volume_from_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:20:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Lock "cinder-quobyte-398ae50b-9bdc-4d01-83db-97f2f18aed33" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:20:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] snapshot: 342676ca-caab-4246-ba70-3bf4b75be45d, volume: 398ae50b-9bdc-4d01-83db-97f2f18aed33, {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 08:20:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:25 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[31630d4b-e0be-4a12-b49f-7263cea18f34]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:20:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.342676ca-caab-4246-ba70-3bf4b75be45d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:25 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.342676ca-caab-4246-ba70-3bf4b75be45d Nov 03 08:20:25 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:25 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-cf07ade5-9b56-4f94-977d-b9647a8f665f req-564362e0-5ad6-419f-93c8-71003c72dffd tempest-AttachVolumeTestJSON-615484012 None] Terminate volume connection completed successfully. Nov 03 08:20:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-cf07ade5-9b56-4f94-977d-b9647a8f665f req-564362e0-5ad6-419f-93c8-71003c72dffd tempest-AttachVolumeTestJSON-615484012 None] Deleting attachment 8917a9cc-7d56-4400-8470-4a95f571c6b6. {{(pid=86801) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 08:20:25 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.342676ca-caab-4246-ba70-3bf4b75be45d" returned: 0 in 0.400s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4737989-f4f1-48ed-863d-da703b0db6c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:20:25 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2154024-3cf1-4b53-9b81-872c73938570]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:20:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:25 devstack sudo[95376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3 Nov 03 08:20:25 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:26 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3" returned: 0 in 0.389s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:26 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3 {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 08:20:26 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Creating direct copy from snapshot {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 08:20:26 devstack cinder-volume[86801]: DEBUG cinder.utils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Path /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-398ae50b-9bdc-4d01-83db-97f2f18aed33 not found in is_blk_device check {{(pid=86801) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 08:20:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-398ae50b-9bdc-4d01-83db-97f2f18aed33 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:26 devstack sudo[95381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-398ae50b-9bdc-4d01-83db-97f2f18aed33 Nov 03 08:20:26 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:27 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-ce7367be-b2fb-48c8-a2a9-62fd67a4510d req-03b56ce9-37ff-4f09-91d0-5320679b55ef tempest-AttachVolumeTestJSON-615484012 None] Terminate volume connection completed successfully. Nov 03 08:20:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-ce7367be-b2fb-48c8-a2a9-62fd67a4510d req-03b56ce9-37ff-4f09-91d0-5320679b55ef tempest-AttachVolumeTestJSON-615484012 None] Deleting attachment 80a5369d-deb1-42fc-ba1a-9923a95d1f9d. {{(pid=86801) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 08:20:34 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-398ae50b-9bdc-4d01-83db-97f2f18aed33" returned: 0 in 8.026s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:34 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3, size 1024.00 MB, duration 8.03 sec, destination /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-398ae50b-9bdc-4d01-83db-97f2f18aed33 {{(pid=86801) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 08:20:34 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Converted 1024.00 MB image at 127.57 MB/s Nov 03 08:20:34 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-398ae50b-9bdc-4d01-83db-97f2f18aed33 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 08:20:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-398ae50b-9bdc-4d01-83db-97f2f18aed33 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:34 devstack sudo[95445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-398ae50b-9bdc-4d01-83db-97f2f18aed33 Nov 03 08:20:34 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-165c9af5-9ddb-4d1c-b472-bf8b747e528b tempest-AttachVolumeTestJSON-615484012 None] Acquiring lock "cinder-38c77d25-972b-46a1-b3ae-852471ebab87-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:20:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-165c9af5-9ddb-4d1c-b472-bf8b747e528b tempest-AttachVolumeTestJSON-615484012 None] Lock "cinder-38c77d25-972b-46a1-b3ae-852471ebab87-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:20:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-165c9af5-9ddb-4d1c-b472-bf8b747e528b tempest-AttachVolumeTestJSON-615484012 None] Acquiring lock "cinder-quobyte-38c77d25-972b-46a1-b3ae-852471ebab87" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:20:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-165c9af5-9ddb-4d1c-b472-bf8b747e528b tempest-AttachVolumeTestJSON-615484012 None] Lock "cinder-quobyte-38c77d25-972b-46a1-b3ae-852471ebab87" acquired by "delete_volume" :: waited 0.015s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:20:34 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec25f3d-c7b9-499a-804a-483f3767c021]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:20:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-165c9af5-9ddb-4d1c-b472-bf8b747e528b tempest-AttachVolumeTestJSON-615484012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-38c77d25-972b-46a1-b3ae-852471ebab87 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:34 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-398ae50b-9bdc-4d01-83db-97f2f18aed33" returned: 0 in 0.255s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Lock "cinder-quobyte-398ae50b-9bdc-4d01-83db-97f2f18aed33" released by "_copy_volume_from_snapshot" :: held 9.148s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Acquiring lock "cinder-quobyte-342676ca-caab-4246-ba70-3bf4b75be45d" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:20:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Lock "cinder-quobyte-342676ca-caab-4246-ba70-3bf4b75be45d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:20:34 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Deleting offline snapshot 342676ca-caab-4246-ba70-3bf4b75be45d of volume c4737989-f4f1-48ed-863d-da703b0db6c3 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:20:34 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] snapshot_file for this snap is: volume-c4737989-f4f1-48ed-863d-da703b0db6c3.342676ca-caab-4246-ba70-3bf4b75be45d {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:20:34 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6a94d2-1581-4946-ac02-4b66e477521b]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:20:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.342676ca-caab-4246-ba70-3bf4b75be45d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:34 devstack sudo[95448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-38c77d25-972b-46a1-b3ae-852471ebab87 Nov 03 08:20:34 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:34 devstack sudo[95450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.342676ca-caab-4246-ba70-3bf4b75be45d Nov 03 08:20:34 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:34 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-165c9af5-9ddb-4d1c-b472-bf8b747e528b tempest-AttachVolumeTestJSON-615484012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-38c77d25-972b-46a1-b3ae-852471ebab87" returned: 0 in 0.371s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-165c9af5-9ddb-4d1c-b472-bf8b747e528b tempest-AttachVolumeTestJSON-615484012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-38c77d25-972b-46a1-b3ae-852471ebab87 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:34 devstack sudo[95455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-38c77d25-972b-46a1-b3ae-852471ebab87 Nov 03 08:20:34 devstack sudo[95455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:35 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.342676ca-caab-4246-ba70-3bf4b75be45d" returned: 0 in 0.380s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4737989-f4f1-48ed-863d-da703b0db6c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:20:35 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[9834f6ef-7b99-4698-88e9-37bd06beaa4f]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:20:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:35 devstack sudo[95460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3 Nov 03 08:20:35 devstack sudo[95460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:35 devstack sudo[95455]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-165c9af5-9ddb-4d1c-b472-bf8b747e528b tempest-AttachVolumeTestJSON-615484012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-38c77d25-972b-46a1-b3ae-852471ebab87" returned: 0 in 0.271s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-165c9af5-9ddb-4d1c-b472-bf8b747e528b tempest-AttachVolumeTestJSON-615484012 None] Lock "cinder-quobyte-38c77d25-972b-46a1-b3ae-852471ebab87" released by "delete_volume" :: held 0.701s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:35 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-165c9af5-9ddb-4d1c-b472-bf8b747e528b tempest-AttachVolumeTestJSON-615484012 None] Created reservations ['5e20a64f-9043-4b37-8eb0-e745bc791fe7', 'f9670f44-4366-4785-aed1-629aa67caa21', 'a83bdc88-1f4f-4faf-98d6-81263234533f', '1f105379-6974-4524-b735-5c5c0adf724b'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:20:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-165c9af5-9ddb-4d1c-b472-bf8b747e528b tempest-AttachVolumeTestJSON-615484012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-165c9af5-9ddb-4d1c-b472-bf8b747e528b tempest-AttachVolumeTestJSON-615484012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-165c9af5-9ddb-4d1c-b472-bf8b747e528b tempest-AttachVolumeTestJSON-615484012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-165c9af5-9ddb-4d1c-b472-bf8b747e528b tempest-AttachVolumeTestJSON-615484012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-165c9af5-9ddb-4d1c-b472-bf8b747e528b tempest-AttachVolumeTestJSON-615484012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-165c9af5-9ddb-4d1c-b472-bf8b747e528b tempest-AttachVolumeTestJSON-615484012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:35 devstack sudo[95464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:20:35 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:35 devstack sudo[95460]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3" returned: 0 in 0.541s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.342676ca-caab-4246-ba70-3bf4b75be45d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:35 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-be8108e2-9592-4fdd-86b4-d7af2abcd447 tempest-AttachVolumeTestJSON-615484012 None] Acquiring lock "cinder-b4bdb24f-226c-4849-b663-3f2c6faf3260-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:20:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-165c9af5-9ddb-4d1c-b472-bf8b747e528b tempest-AttachVolumeTestJSON-615484012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.268s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:35 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.342676ca-caab-4246-ba70-3bf4b75be45d Nov 03 08:20:35 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-165c9af5-9ddb-4d1c-b472-bf8b747e528b tempest-AttachVolumeTestJSON-615484012 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:20:35 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:35 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-165c9af5-9ddb-4d1c-b472-bf8b747e528b tempest-AttachVolumeTestJSON-615484012 None] Deleted volume successfully. Nov 03 08:20:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-be8108e2-9592-4fdd-86b4-d7af2abcd447 tempest-AttachVolumeTestJSON-615484012 None] Lock "cinder-b4bdb24f-226c-4849-b663-3f2c6faf3260-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:20:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-165c9af5-9ddb-4d1c-b472-bf8b747e528b tempest-AttachVolumeTestJSON-615484012 None] Lock "cinder-38c77d25-972b-46a1-b3ae-852471ebab87-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-be8108e2-9592-4fdd-86b4-d7af2abcd447 tempest-AttachVolumeTestJSON-615484012 None] Acquiring lock "cinder-quobyte-b4bdb24f-226c-4849-b663-3f2c6faf3260" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:20:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-be8108e2-9592-4fdd-86b4-d7af2abcd447 tempest-AttachVolumeTestJSON-615484012 None] Lock "cinder-quobyte-b4bdb24f-226c-4849-b663-3f2c6faf3260" acquired by "delete_volume" :: waited 0.014s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:20:35 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c400e3-713c-4064-88dc-f61011268c4e]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:20:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-be8108e2-9592-4fdd-86b4-d7af2abcd447 tempest-AttachVolumeTestJSON-615484012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b4bdb24f-226c-4849-b663-3f2c6faf3260 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:35 devstack sudo[95471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b4bdb24f-226c-4849-b663-3f2c6faf3260 Nov 03 08:20:35 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:35 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.342676ca-caab-4246-ba70-3bf4b75be45d" returned: 0 in 0.343s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.342676ca-caab-4246-ba70-3bf4b75be45d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:35 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.342676ca-caab-4246-ba70-3bf4b75be45d Nov 03 08:20:35 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:36 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-be8108e2-9592-4fdd-86b4-d7af2abcd447 tempest-AttachVolumeTestJSON-615484012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b4bdb24f-226c-4849-b663-3f2c6faf3260" returned: 0 in 0.393s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-be8108e2-9592-4fdd-86b4-d7af2abcd447 tempest-AttachVolumeTestJSON-615484012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b4bdb24f-226c-4849-b663-3f2c6faf3260 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:36 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b4bdb24f-226c-4849-b663-3f2c6faf3260 Nov 03 08:20:36 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:36 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3.342676ca-caab-4246-ba70-3bf4b75be45d" returned: 0 in 0.261s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Lock "cinder-quobyte-342676ca-caab-4246-ba70-3bf4b75be45d" released by "_delete_snapshot" :: held 1.631s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.143s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.461s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2c2c3dfe-823e-44cd-9a26-d32b38fe0ecf,created_at=2026-11-03T07:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-941070485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2c2c3dfe-823e-44cd-9a26-d32b38fe0ecf,host='devstack@QuobyteHD#QuobyteHD',id=ee839823-ba56-420f-8f43-39bba8615b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46da085ba503402ab6dbfab4ed93d4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:24Z,use_quota=True,user_id='4d5c0edfd44841f69beb5556cde9e7c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c8d47ce-686e-478e-8b6b-2cf06d8803a1),volume_type_id=0c8d47ce-686e-478e-8b6b-2cf06d8803a1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Creating volume ee839823-ba56-420f-8f43-39bba8615b80 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:20:36 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ee839823-ba56-420f-8f43-39bba8615b80 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:36 devstack sudo[95485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ee839823-ba56-420f-8f43-39bba8615b80 1073741824 Nov 03 08:20:36 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:36 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-1b759522-25f8-4246-8230-9571d9729b1e tempest-GroupsV314Test-800647125 None] Create group from source-group-0d2e4a71-f339-4ebf-8853-4ee9d8f19d20 completed successfully. Nov 03 08:20:36 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-be8108e2-9592-4fdd-86b4-d7af2abcd447 tempest-AttachVolumeTestJSON-615484012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b4bdb24f-226c-4849-b663-3f2c6faf3260" returned: 0 in 0.263s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-be8108e2-9592-4fdd-86b4-d7af2abcd447 tempest-AttachVolumeTestJSON-615484012 None] Lock "cinder-quobyte-b4bdb24f-226c-4849-b663-3f2c6faf3260" released by "delete_volume" :: held 0.696s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-be8108e2-9592-4fdd-86b4-d7af2abcd447 tempest-AttachVolumeTestJSON-615484012 None] Created reservations ['f1f0ded4-a8ac-4ae5-a491-0c71f40fb37d', 'a3eb82ae-e8d2-4769-b5d3-b81a1a0a0e42', '33e97fa6-7e66-4843-9c8e-73930c3d633d', 'ebdff772-6cf9-4b02-b25f-02ad3c679a6e'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-be8108e2-9592-4fdd-86b4-d7af2abcd447 tempest-AttachVolumeTestJSON-615484012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-be8108e2-9592-4fdd-86b4-d7af2abcd447 tempest-AttachVolumeTestJSON-615484012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-be8108e2-9592-4fdd-86b4-d7af2abcd447 tempest-AttachVolumeTestJSON-615484012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-be8108e2-9592-4fdd-86b4-d7af2abcd447 tempest-AttachVolumeTestJSON-615484012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-be8108e2-9592-4fdd-86b4-d7af2abcd447 tempest-AttachVolumeTestJSON-615484012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-be8108e2-9592-4fdd-86b4-d7af2abcd447 tempest-AttachVolumeTestJSON-615484012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:36 devstack sudo[95491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:20:36 devstack sudo[95491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:36 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ee839823-ba56-420f-8f43-39bba8615b80 1073741824" returned: 0 in 0.502s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ee839823-ba56-420f-8f43-39bba8615b80 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:36 devstack sudo[95495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ee839823-ba56-420f-8f43-39bba8615b80 Nov 03 08:20:36 devstack sudo[95495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:36 devstack sudo[95491]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-be8108e2-9592-4fdd-86b4-d7af2abcd447 tempest-AttachVolumeTestJSON-615484012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.313s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-be8108e2-9592-4fdd-86b4-d7af2abcd447 tempest-AttachVolumeTestJSON-615484012 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:20:36 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-be8108e2-9592-4fdd-86b4-d7af2abcd447 tempest-AttachVolumeTestJSON-615484012 None] Deleted volume successfully. Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-be8108e2-9592-4fdd-86b4-d7af2abcd447 tempest-AttachVolumeTestJSON-615484012 None] Lock "cinder-b4bdb24f-226c-4849-b663-3f2c6faf3260-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d68c1a89-b3b3-4943-a1e7-88e7fe740da3 tempest-AttachVolumeTestJSON-615484012 None] Acquiring lock "cinder-8c776ed4-2e89-41eb-8a65-5b97a51ca51e-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d68c1a89-b3b3-4943-a1e7-88e7fe740da3 tempest-AttachVolumeTestJSON-615484012 None] Lock "cinder-8c776ed4-2e89-41eb-8a65-5b97a51ca51e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:20:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a48deaf0-1609-4c98-9732-fbbc1812e8c2 tempest-GroupsV314Test-800647125 None] Acquiring lock "cinder-quobyte-398ae50b-9bdc-4d01-83db-97f2f18aed33" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d68c1a89-b3b3-4943-a1e7-88e7fe740da3 tempest-AttachVolumeTestJSON-615484012 None] Acquiring lock "cinder-quobyte-8c776ed4-2e89-41eb-8a65-5b97a51ca51e" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d68c1a89-b3b3-4943-a1e7-88e7fe740da3 tempest-AttachVolumeTestJSON-615484012 None] Lock "cinder-quobyte-8c776ed4-2e89-41eb-8a65-5b97a51ca51e" acquired by "delete_volume" :: waited 0.031s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a48deaf0-1609-4c98-9732-fbbc1812e8c2 tempest-GroupsV314Test-800647125 None] Lock "cinder-quobyte-398ae50b-9bdc-4d01-83db-97f2f18aed33" acquired by "delete_volume" :: waited 0.060s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46e06c7-1681-4404-bf66-85510fe15b4d]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d68c1a89-b3b3-4943-a1e7-88e7fe740da3 tempest-AttachVolumeTestJSON-615484012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8c776ed4-2e89-41eb-8a65-5b97a51ca51e {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:37 devstack sudo[95495]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1054cb-224a-43a8-865e-1395f4b9dfd6]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a48deaf0-1609-4c98-9732-fbbc1812e8c2 tempest-GroupsV314Test-800647125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-398ae50b-9bdc-4d01-83db-97f2f18aed33 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ee839823-ba56-420f-8f43-39bba8615b80" returned: 0 in 0.297s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.597s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1635737851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97007ad5-4102-456e-ba9d-6ecf018e672b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9406126b1cf847349c800bad85613de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:24Z,use_quota=True,user_id='82c5c7446a28466ab2fcda00f7599b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Creating volume 97007ad5-4102-456e-ba9d-6ecf018e672b {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:20:37 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97007ad5-4102-456e-ba9d-6ecf018e672b 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd6739b1-2e47-4c0c-ba8a-0473baf4bdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee839823-ba56-420f-8f43-39bba8615b80', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:37 devstack sudo[95500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97007ad5-4102-456e-ba9d-6ecf018e672b 1073741824 Nov 03 08:20:37 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a7a492d-d3c2-4f4c-a9ff-01cf4a418dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:37 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Volume volume-ee839823-ba56-420f-8f43-39bba8615b80 (ee839823-ba56-420f-8f43-39bba8615b80): created successfully Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a7a492d-d3c2-4f4c-a9ff-01cf4a418dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Flow 'volume_create_manager' (428a643e-e945-4f7e-ae74-22b151fcbbdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:20:37 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-340d98db-b9c9-4091-8e4f-04f4bdf8a72d tempest-GroupsTest-868371497 None] Created volume successfully. Nov 03 08:20:37 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-398ae50b-9bdc-4d01-83db-97f2f18aed33 Nov 03 08:20:37 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:37 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8c776ed4-2e89-41eb-8a65-5b97a51ca51e Nov 03 08:20:37 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:37 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a48deaf0-1609-4c98-9732-fbbc1812e8c2 tempest-GroupsV314Test-800647125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-398ae50b-9bdc-4d01-83db-97f2f18aed33" returned: 0 in 0.437s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a48deaf0-1609-4c98-9732-fbbc1812e8c2 tempest-GroupsV314Test-800647125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-398ae50b-9bdc-4d01-83db-97f2f18aed33 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:37 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-398ae50b-9bdc-4d01-83db-97f2f18aed33 Nov 03 08:20:37 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:37 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d68c1a89-b3b3-4943-a1e7-88e7fe740da3 tempest-AttachVolumeTestJSON-615484012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8c776ed4-2e89-41eb-8a65-5b97a51ca51e" returned: 0 in 0.499s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d68c1a89-b3b3-4943-a1e7-88e7fe740da3 tempest-AttachVolumeTestJSON-615484012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8c776ed4-2e89-41eb-8a65-5b97a51ca51e {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:37 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8c776ed4-2e89-41eb-8a65-5b97a51ca51e Nov 03 08:20:37 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:37 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97007ad5-4102-456e-ba9d-6ecf018e672b 1073741824" returned: 0 in 0.472s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97007ad5-4102-456e-ba9d-6ecf018e672b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:37 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97007ad5-4102-456e-ba9d-6ecf018e672b Nov 03 08:20:37 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:37 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a48deaf0-1609-4c98-9732-fbbc1812e8c2 tempest-GroupsV314Test-800647125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-398ae50b-9bdc-4d01-83db-97f2f18aed33" returned: 0 in 0.270s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a48deaf0-1609-4c98-9732-fbbc1812e8c2 tempest-GroupsV314Test-800647125 None] Lock "cinder-quobyte-398ae50b-9bdc-4d01-83db-97f2f18aed33" released by "delete_volume" :: held 0.772s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:37 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d68c1a89-b3b3-4943-a1e7-88e7fe740da3 tempest-AttachVolumeTestJSON-615484012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8c776ed4-2e89-41eb-8a65-5b97a51ca51e" returned: 0 in 0.272s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d68c1a89-b3b3-4943-a1e7-88e7fe740da3 tempest-AttachVolumeTestJSON-615484012 None] Lock "cinder-quobyte-8c776ed4-2e89-41eb-8a65-5b97a51ca51e" released by "delete_volume" :: held 0.829s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:37 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-a48deaf0-1609-4c98-9732-fbbc1812e8c2 tempest-GroupsV314Test-800647125 None] Created reservations ['f1cfdc8d-a497-4b3d-b647-1d46242cd7b3'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97007ad5-4102-456e-ba9d-6ecf018e672b" returned: 0 in 0.265s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:37 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-d68c1a89-b3b3-4943-a1e7-88e7fe740da3 tempest-AttachVolumeTestJSON-615484012 None] Created reservations ['0e39fa9d-96a5-4cc5-b081-9959bd0375b9', '992e25fd-c688-4878-ac30-13626476cc9f', 'ef86bbf3-7ae1-4dca-83eb-4368da44c4fa', '2f1b6979-7ca1-41e7-bc4b-2f121429ae28'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:20:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92aea69-6e2c-4524-ad88-39453e971fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97007ad5-4102-456e-ba9d-6ecf018e672b', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65286a95-8baa-4c83-8d85-794067bfd74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:38 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Volume volume-97007ad5-4102-456e-ba9d-6ecf018e672b (97007ad5-4102-456e-ba9d-6ecf018e672b): created successfully Nov 03 08:20:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65286a95-8baa-4c83-8d85-794067bfd74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Flow 'volume_create_manager' (96e4b94e-b494-4dce-b1a4-2b189fc31360) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:20:38 devstack cinder-volume[86801]: WARNING cinder.quota [None req-a48deaf0-1609-4c98-9732-fbbc1812e8c2 tempest-GroupsV314Test-800647125 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1377108331 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1377108331, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:20:38 devstack cinder-volume[86801]: WARNING cinder.quota [None req-a48deaf0-1609-4c98-9732-fbbc1812e8c2 tempest-GroupsV314Test-800647125 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1377108331 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1377108331, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:20:38 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-f35f9c76-c2ce-4c2a-b233-0ba4dcc64819 tempest-VolumesTransfersV355Test-1836429532 None] Created volume successfully. Nov 03 08:20:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d68c1a89-b3b3-4943-a1e7-88e7fe740da3 tempest-AttachVolumeTestJSON-615484012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d68c1a89-b3b3-4943-a1e7-88e7fe740da3 tempest-AttachVolumeTestJSON-615484012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d68c1a89-b3b3-4943-a1e7-88e7fe740da3 tempest-AttachVolumeTestJSON-615484012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d68c1a89-b3b3-4943-a1e7-88e7fe740da3 tempest-AttachVolumeTestJSON-615484012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d68c1a89-b3b3-4943-a1e7-88e7fe740da3 tempest-AttachVolumeTestJSON-615484012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d68c1a89-b3b3-4943-a1e7-88e7fe740da3 tempest-AttachVolumeTestJSON-615484012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:38 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-a48deaf0-1609-4c98-9732-fbbc1812e8c2 tempest-GroupsV314Test-800647125 None] Created reservations ['2c5fc4ac-0f6f-4b64-8c24-e3aba6e15be6', 'facc918f-2287-4ae0-ba36-87f4c7a5e08b', 'c097669c-e670-4f71-b9e4-d01abf693b8c', '91c2926e-5b38-46d6-ba17-45194688de67'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:20:38 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:20:38 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a48deaf0-1609-4c98-9732-fbbc1812e8c2 tempest-GroupsV314Test-800647125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a48deaf0-1609-4c98-9732-fbbc1812e8c2 tempest-GroupsV314Test-800647125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a48deaf0-1609-4c98-9732-fbbc1812e8c2 tempest-GroupsV314Test-800647125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a48deaf0-1609-4c98-9732-fbbc1812e8c2 tempest-GroupsV314Test-800647125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a48deaf0-1609-4c98-9732-fbbc1812e8c2 tempest-GroupsV314Test-800647125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a48deaf0-1609-4c98-9732-fbbc1812e8c2 tempest-GroupsV314Test-800647125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:38 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:20:38 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:38 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d68c1a89-b3b3-4943-a1e7-88e7fe740da3 tempest-AttachVolumeTestJSON-615484012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.304s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:38 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-d68c1a89-b3b3-4943-a1e7-88e7fe740da3 tempest-AttachVolumeTestJSON-615484012 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:20:38 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-d68c1a89-b3b3-4943-a1e7-88e7fe740da3 tempest-AttachVolumeTestJSON-615484012 None] Deleted volume successfully. Nov 03 08:20:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d68c1a89-b3b3-4943-a1e7-88e7fe740da3 tempest-AttachVolumeTestJSON-615484012 None] Lock "cinder-8c776ed4-2e89-41eb-8a65-5b97a51ca51e-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:38 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a48deaf0-1609-4c98-9732-fbbc1812e8c2 tempest-GroupsV314Test-800647125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.293s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:38 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-a48deaf0-1609-4c98-9732-fbbc1812e8c2 tempest-GroupsV314Test-800647125 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:20:38 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-a48deaf0-1609-4c98-9732-fbbc1812e8c2 tempest-GroupsV314Test-800647125 None] Delete group completed successfully. Nov 03 08:20:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-70629fcc-3905-4894-8559-a9a3be183190 tempest-VolumesTransfersV355Test-726897585 None] Acquiring lock "cinder-97007ad5-4102-456e-ba9d-6ecf018e672b-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:20:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-70629fcc-3905-4894-8559-a9a3be183190 tempest-VolumesTransfersV355Test-726897585 None] Lock "cinder-97007ad5-4102-456e-ba9d-6ecf018e672b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:20:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-70629fcc-3905-4894-8559-a9a3be183190 tempest-VolumesTransfersV355Test-726897585 None] Acquiring lock "cinder-quobyte-97007ad5-4102-456e-ba9d-6ecf018e672b" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:20:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-70629fcc-3905-4894-8559-a9a3be183190 tempest-VolumesTransfersV355Test-726897585 None] Lock "cinder-quobyte-97007ad5-4102-456e-ba9d-6ecf018e672b" acquired by "delete_volume" :: waited 0.020s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:20:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e329c85a-e1d8-482c-a860-5ac66bfcecd1 tempest-GroupsTest-868371497 None] Acquiring lock "cinder-quobyte-ee839823-ba56-420f-8f43-39bba8615b80" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:20:39 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[4268d457-0fbd-4ddd-9080-367ca887e63d]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:20:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-70629fcc-3905-4894-8559-a9a3be183190 tempest-VolumesTransfersV355Test-726897585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97007ad5-4102-456e-ba9d-6ecf018e672b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e329c85a-e1d8-482c-a860-5ac66bfcecd1 tempest-GroupsTest-868371497 None] Lock "cinder-quobyte-ee839823-ba56-420f-8f43-39bba8615b80" acquired by "delete_volume" :: waited 0.030s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:20:39 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d47396-d302-4f30-b3d8-f117b963f982]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:20:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e329c85a-e1d8-482c-a860-5ac66bfcecd1 tempest-GroupsTest-868371497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ee839823-ba56-420f-8f43-39bba8615b80 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:39 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97007ad5-4102-456e-ba9d-6ecf018e672b Nov 03 08:20:39 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:39 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ee839823-ba56-420f-8f43-39bba8615b80 Nov 03 08:20:39 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0af33ea9-f3ff-4b5d-aff7-567ebf21d654 tempest-GroupsV314Test-800647125 None] Acquiring lock "cinder-quobyte-c4737989-f4f1-48ed-863d-da703b0db6c3" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:20:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0af33ea9-f3ff-4b5d-aff7-567ebf21d654 tempest-GroupsV314Test-800647125 None] Lock "cinder-quobyte-c4737989-f4f1-48ed-863d-da703b0db6c3" acquired by "delete_volume" :: waited 0.035s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:20:39 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0e1f9e-a963-47e3-97d9-52c16befdce3]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:20:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0af33ea9-f3ff-4b5d-aff7-567ebf21d654 tempest-GroupsV314Test-800647125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:39 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-70629fcc-3905-4894-8559-a9a3be183190 tempest-VolumesTransfersV355Test-726897585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97007ad5-4102-456e-ba9d-6ecf018e672b" returned: 0 in 0.579s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-70629fcc-3905-4894-8559-a9a3be183190 tempest-VolumesTransfersV355Test-726897585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97007ad5-4102-456e-ba9d-6ecf018e672b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:39 devstack sudo[95540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97007ad5-4102-456e-ba9d-6ecf018e672b Nov 03 08:20:39 devstack sudo[95540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:39 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e329c85a-e1d8-482c-a860-5ac66bfcecd1 tempest-GroupsTest-868371497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ee839823-ba56-420f-8f43-39bba8615b80" returned: 0 in 0.580s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e329c85a-e1d8-482c-a860-5ac66bfcecd1 tempest-GroupsTest-868371497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ee839823-ba56-420f-8f43-39bba8615b80 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:39 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ee839823-ba56-420f-8f43-39bba8615b80 Nov 03 08:20:39 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:39 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3 Nov 03 08:20:39 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:40 devstack sudo[95540]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-70629fcc-3905-4894-8559-a9a3be183190 tempest-VolumesTransfersV355Test-726897585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-97007ad5-4102-456e-ba9d-6ecf018e672b" returned: 0 in 0.250s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-70629fcc-3905-4894-8559-a9a3be183190 tempest-VolumesTransfersV355Test-726897585 None] Lock "cinder-quobyte-97007ad5-4102-456e-ba9d-6ecf018e672b" released by "delete_volume" :: held 0.890s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-70629fcc-3905-4894-8559-a9a3be183190 tempest-VolumesTransfersV355Test-726897585 None] Created reservations ['bb1fbccd-6ce9-478d-9968-fe9d131c248a', '76d27570-2d02-4fe7-93f6-149ea65377f1', '45b0d07f-eb16-41a7-aa76-da45315bbd15', '8d90649e-528e-4935-8c03-ff1a949d68b4'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:20:40 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e329c85a-e1d8-482c-a860-5ac66bfcecd1 tempest-GroupsTest-868371497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ee839823-ba56-420f-8f43-39bba8615b80" returned: 0 in 0.334s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e329c85a-e1d8-482c-a860-5ac66bfcecd1 tempest-GroupsTest-868371497 None] Lock "cinder-quobyte-ee839823-ba56-420f-8f43-39bba8615b80" released by "delete_volume" :: held 1.002s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:40 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0af33ea9-f3ff-4b5d-aff7-567ebf21d654 tempest-GroupsV314Test-800647125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3" returned: 0 in 0.498s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0af33ea9-f3ff-4b5d-aff7-567ebf21d654 tempest-GroupsV314Test-800647125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:40 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3 Nov 03 08:20:40 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-70629fcc-3905-4894-8559-a9a3be183190 tempest-VolumesTransfersV355Test-726897585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-70629fcc-3905-4894-8559-a9a3be183190 tempest-VolumesTransfersV355Test-726897585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-70629fcc-3905-4894-8559-a9a3be183190 tempest-VolumesTransfersV355Test-726897585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-70629fcc-3905-4894-8559-a9a3be183190 tempest-VolumesTransfersV355Test-726897585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-70629fcc-3905-4894-8559-a9a3be183190 tempest-VolumesTransfersV355Test-726897585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-70629fcc-3905-4894-8559-a9a3be183190 tempest-VolumesTransfersV355Test-726897585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:40 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:20:40 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-e329c85a-e1d8-482c-a860-5ac66bfcecd1 tempest-GroupsTest-868371497 None] Created reservations ['ca2aaf51-355f-41bc-8c05-dfe4dea9cf0b'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:20:40 devstack cinder-volume[86801]: WARNING cinder.quota [None req-e329c85a-e1d8-482c-a860-5ac66bfcecd1 tempest-GroupsTest-868371497 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1132369392 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1132369392, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:20:40 devstack cinder-volume[86801]: WARNING cinder.quota [None req-e329c85a-e1d8-482c-a860-5ac66bfcecd1 tempest-GroupsTest-868371497 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1132369392 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1132369392, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-e329c85a-e1d8-482c-a860-5ac66bfcecd1 tempest-GroupsTest-868371497 None] Created reservations ['5862e33c-d91e-4230-96f4-422db17ea61d', '98a5b19d-bad9-40b7-8367-5a42f79769fe', 'dbf7e47a-ed3d-4991-b580-0928e41e1b50', '485202ac-da46-4e47-bd2f-1dcf635aa0c2'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e329c85a-e1d8-482c-a860-5ac66bfcecd1 tempest-GroupsTest-868371497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e329c85a-e1d8-482c-a860-5ac66bfcecd1 tempest-GroupsTest-868371497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e329c85a-e1d8-482c-a860-5ac66bfcecd1 tempest-GroupsTest-868371497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e329c85a-e1d8-482c-a860-5ac66bfcecd1 tempest-GroupsTest-868371497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e329c85a-e1d8-482c-a860-5ac66bfcecd1 tempest-GroupsTest-868371497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e329c85a-e1d8-482c-a860-5ac66bfcecd1 tempest-GroupsTest-868371497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:40 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0af33ea9-f3ff-4b5d-aff7-567ebf21d654 tempest-GroupsV314Test-800647125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c4737989-f4f1-48ed-863d-da703b0db6c3" returned: 0 in 0.378s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:40 devstack sudo[95558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:20:40 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0af33ea9-f3ff-4b5d-aff7-567ebf21d654 tempest-GroupsV314Test-800647125 None] Lock "cinder-quobyte-c4737989-f4f1-48ed-863d-da703b0db6c3" released by "delete_volume" :: held 0.984s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:40 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-70629fcc-3905-4894-8559-a9a3be183190 tempest-VolumesTransfersV355Test-726897585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.374s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-70629fcc-3905-4894-8559-a9a3be183190 tempest-VolumesTransfersV355Test-726897585 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:20:40 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-70629fcc-3905-4894-8559-a9a3be183190 tempest-VolumesTransfersV355Test-726897585 None] Deleted volume successfully. Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-70629fcc-3905-4894-8559-a9a3be183190 tempest-VolumesTransfersV355Test-726897585 None] Lock "cinder-97007ad5-4102-456e-ba9d-6ecf018e672b-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-0af33ea9-f3ff-4b5d-aff7-567ebf21d654 tempest-GroupsV314Test-800647125 None] Created reservations ['1051fad3-2ec5-45f0-a313-c797f47ebeb8'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-0af33ea9-f3ff-4b5d-aff7-567ebf21d654 tempest-GroupsV314Test-800647125 None] Created reservations ['822cb9a4-b330-4ca1-8399-f297f4e1d0ec', '6e0ea1f9-1727-4e9f-b94b-050b11f09670', '9e2b9768-0841-4b85-b331-d99493ffab7d', '9be8af64-3e25-4dea-a546-b109a4593072'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0af33ea9-f3ff-4b5d-aff7-567ebf21d654 tempest-GroupsV314Test-800647125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0af33ea9-f3ff-4b5d-aff7-567ebf21d654 tempest-GroupsV314Test-800647125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0af33ea9-f3ff-4b5d-aff7-567ebf21d654 tempest-GroupsV314Test-800647125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0af33ea9-f3ff-4b5d-aff7-567ebf21d654 tempest-GroupsV314Test-800647125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0af33ea9-f3ff-4b5d-aff7-567ebf21d654 tempest-GroupsV314Test-800647125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0af33ea9-f3ff-4b5d-aff7-567ebf21d654 tempest-GroupsV314Test-800647125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:40 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e329c85a-e1d8-482c-a860-5ac66bfcecd1 tempest-GroupsTest-868371497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.320s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:40 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-e329c85a-e1d8-482c-a860-5ac66bfcecd1 tempest-GroupsTest-868371497 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:20:40 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-e329c85a-e1d8-482c-a860-5ac66bfcecd1 tempest-GroupsTest-868371497 None] Delete group completed successfully. Nov 03 08:20:40 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:20:40 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:41 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0af33ea9-f3ff-4b5d-aff7-567ebf21d654 tempest-GroupsV314Test-800647125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.252s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:41 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-0af33ea9-f3ff-4b5d-aff7-567ebf21d654 tempest-GroupsV314Test-800647125 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:20:41 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-0af33ea9-f3ff-4b5d-aff7-567ebf21d654 tempest-GroupsV314Test-800647125 None] Delete group completed successfully. Nov 03 08:20:41 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-6fbc6bbe-a86c-4989-b439-c0bc8a7bc9b0 tempest-GroupsTest-868371497 None] Created reservations ['ea1d1744-5f9d-4d3d-ba08-eee76910278b'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:20:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6fbc6bbe-a86c-4989-b439-c0bc8a7bc9b0 tempest-GroupsTest-868371497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6fbc6bbe-a86c-4989-b439-c0bc8a7bc9b0 tempest-GroupsTest-868371497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6fbc6bbe-a86c-4989-b439-c0bc8a7bc9b0 tempest-GroupsTest-868371497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6fbc6bbe-a86c-4989-b439-c0bc8a7bc9b0 tempest-GroupsTest-868371497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6fbc6bbe-a86c-4989-b439-c0bc8a7bc9b0 tempest-GroupsTest-868371497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6fbc6bbe-a86c-4989-b439-c0bc8a7bc9b0 tempest-GroupsTest-868371497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:41 devstack sudo[95564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:20:41 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:42 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6fbc6bbe-a86c-4989-b439-c0bc8a7bc9b0 tempest-GroupsTest-868371497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.292s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:42 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-6fbc6bbe-a86c-4989-b439-c0bc8a7bc9b0 tempest-GroupsTest-868371497 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:20:42 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-6fbc6bbe-a86c-4989-b439-c0bc8a7bc9b0 tempest-GroupsTest-868371497 None] Delete group completed successfully. Nov 03 08:20:43 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-5b3e5775-980f-47ab-9e7c-646260ac2ac0 tempest-GroupsTest-868371497 None] Group tempest-GroupsTest-Group-105440741: creating Nov 03 08:20:43 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-5b3e5775-980f-47ab-9e7c-646260ac2ac0 tempest-GroupsTest-868371497 None] Group tempest-GroupsTest-Group-105440741: created successfully Nov 03 08:20:43 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-5b3e5775-980f-47ab-9e7c-646260ac2ac0 tempest-GroupsTest-868371497 None] Create group completed successfully. Nov 03 08:20:45 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:20:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Flow 'volume_create_manager' (d1c19379-6679-4548-acfe-82233767f251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:20:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19698cce-46b3-42dc-91e1-ac439feaa6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19698cce-46b3-42dc-91e1-ac439feaa6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-839565549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66e0c7fc-74ba-4231-b563-5313d4eeedc9,host='devstack@QuobyteHD#QuobyteHD',id=be8f903f-02c9-4066-82b4-309a652f9663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46da085ba503402ab6dbfab4ed93d4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:45Z,use_quota=True,user_id='4d5c0edfd44841f69beb5556cde9e7c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57ce16f7-4d57-4c73-9ec4-0ecc99952058),volume_type_id=57ce16f7-4d57-4c73-9ec4-0ecc99952058)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc23575-344e-4644-9769-4e1ed5f9da85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc23575-344e-4644-9769-4e1ed5f9da85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ed9c76-3f7f-4618-b49c-267645e26870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ed9c76-3f7f-4618-b49c-267645e26870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be8f903f-02c9-4066-82b4-309a652f9663', 'volume_name': 'volume-be8f903f-02c9-4066-82b4-309a652f9663', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81fca78-73fe-4fe4-b44c-d5af1d7ca4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81fca78-73fe-4fe4-b44c-d5af1d7ca4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb90a7e-9e2f-449c-a93a-d25bd3aaa0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:45 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Volume be8f903f-02c9-4066-82b4-309a652f9663: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be8f903f-02c9-4066-82b4-309a652f9663', 'volume_size': 1} Nov 03 08:20:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:45 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=66e0c7fc-74ba-4231-b563-5313d4eeedc9,created_at=2026-11-03T07:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-839565549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66e0c7fc-74ba-4231-b563-5313d4eeedc9,host='devstack@QuobyteHD#QuobyteHD',id=be8f903f-02c9-4066-82b4-309a652f9663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46da085ba503402ab6dbfab4ed93d4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:45Z,use_quota=True,user_id='4d5c0edfd44841f69beb5556cde9e7c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57ce16f7-4d57-4c73-9ec4-0ecc99952058),volume_type_id=57ce16f7-4d57-4c73-9ec4-0ecc99952058)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:20:45 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Creating volume be8f903f-02c9-4066-82b4-309a652f9663 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:20:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:45 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:45 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:45 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:20:45 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:20:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-be8f903f-02c9-4066-82b4-309a652f9663 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:45 devstack sudo[95571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-be8f903f-02c9-4066-82b4-309a652f9663 1073741824 Nov 03 08:20:45 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:46 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-be8f903f-02c9-4066-82b4-309a652f9663 1073741824" returned: 0 in 0.612s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-be8f903f-02c9-4066-82b4-309a652f9663 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:46 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-be8f903f-02c9-4066-82b4-309a652f9663 Nov 03 08:20:46 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:46 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-be8f903f-02c9-4066-82b4-309a652f9663" returned: 0 in 0.339s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:20:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb90a7e-9e2f-449c-a93a-d25bd3aaa0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be8f903f-02c9-4066-82b4-309a652f9663', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (381fdb58-d577-4974-a320-9b0220507218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:46 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Volume volume-be8f903f-02c9-4066-82b4-309a652f9663 (be8f903f-02c9-4066-82b4-309a652f9663): created successfully Nov 03 08:20:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (381fdb58-d577-4974-a320-9b0220507218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Flow 'volume_create_manager' (d1c19379-6679-4548-acfe-82233767f251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:20:46 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-e89b41e8-baad-4f95-b540-d91c8b105c55 tempest-GroupsTest-868371497 None] Created volume successfully. Nov 03 08:20:48 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:20:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Flow 'volume_create_manager' (042e914c-2735-416f-b205-5fc9f7ba59fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:20:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51810c1e-c4a9-4235-a072-47374d64538b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51810c1e-c4a9-4235-a072-47374d64538b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-547633330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66e0c7fc-74ba-4231-b563-5313d4eeedc9,host='devstack@QuobyteHD#QuobyteHD',id=1b4b2398-a330-4841-9cf1-f806d49fa31a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46da085ba503402ab6dbfab4ed93d4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:48Z,use_quota=True,user_id='4d5c0edfd44841f69beb5556cde9e7c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57ce16f7-4d57-4c73-9ec4-0ecc99952058),volume_type_id=57ce16f7-4d57-4c73-9ec4-0ecc99952058)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7838024b-e714-4e39-8330-ce69f659389f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7838024b-e714-4e39-8330-ce69f659389f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce75b18b-5823-4c22-af2b-c5d86a832566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce75b18b-5823-4c22-af2b-c5d86a832566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b4b2398-a330-4841-9cf1-f806d49fa31a', 'volume_name': 'volume-1b4b2398-a330-4841-9cf1-f806d49fa31a', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a203af4-230f-4bba-8976-ab1bad90c453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a203af4-230f-4bba-8976-ab1bad90c453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943467b4-528b-42b6-ab01-bbed5b454fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:48 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Volume 1b4b2398-a330-4841-9cf1-f806d49fa31a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b4b2398-a330-4841-9cf1-f806d49fa31a', 'volume_size': 1} Nov 03 08:20:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=66e0c7fc-74ba-4231-b563-5313d4eeedc9,created_at=2026-11-03T07:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-547633330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66e0c7fc-74ba-4231-b563-5313d4eeedc9,host='devstack@QuobyteHD#QuobyteHD',id=1b4b2398-a330-4841-9cf1-f806d49fa31a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46da085ba503402ab6dbfab4ed93d4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:48Z,use_quota=True,user_id='4d5c0edfd44841f69beb5556cde9e7c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57ce16f7-4d57-4c73-9ec4-0ecc99952058),volume_type_id=57ce16f7-4d57-4c73-9ec4-0ecc99952058)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:20:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Creating volume 1b4b2398-a330-4841-9cf1-f806d49fa31a {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:20:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:20:48 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:20:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b4b2398-a330-4841-9cf1-f806d49fa31a 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:48 devstack sudo[95581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b4b2398-a330-4841-9cf1-f806d49fa31a 1073741824 Nov 03 08:20:48 devstack sudo[95581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:49 devstack sudo[95581]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b4b2398-a330-4841-9cf1-f806d49fa31a 1073741824" returned: 0 in 0.482s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b4b2398-a330-4841-9cf1-f806d49fa31a {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:49 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b4b2398-a330-4841-9cf1-f806d49fa31a Nov 03 08:20:49 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:49 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b4b2398-a330-4841-9cf1-f806d49fa31a" returned: 0 in 0.269s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:49 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:20:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:49 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943467b4-528b-42b6-ab01-bbed5b454fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b4b2398-a330-4841-9cf1-f806d49fa31a', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:49 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a8c576-9553-41bf-9671-90ea1cfc1ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:49 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Volume volume-1b4b2398-a330-4841-9cf1-f806d49fa31a (1b4b2398-a330-4841-9cf1-f806d49fa31a): created successfully Nov 03 08:20:49 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a8c576-9553-41bf-9671-90ea1cfc1ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:49 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Flow 'volume_create_manager' (042e914c-2735-416f-b205-5fc9f7ba59fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:20:49 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-5c3e2db6-0778-47e2-baf5-2613f06f97d0 tempest-GroupsTest-868371497 None] Created volume successfully. Nov 03 08:20:49 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-5d500987-3b1c-4c38-b36e-6aea4aec237c tempest-GroupsTest-868371497 None] Update group completed successfully. Nov 03 08:20:50 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:20:50 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Flow 'volume_create_manager' (6e88d118-0335-45da-9209-14adff6b2610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:20:50 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7c2e8b0-98e6-4a0f-a747-51aefddc9fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:50 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7c2e8b0-98e6-4a0f-a747-51aefddc9fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-620608482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aaa37d0-a3be-410e-a4c5-6304971abc76,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec4114bd9fa546299aa3eaf9b67dbed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:51Z,use_quota=True,user_id='81e88dbe256a4ca7a0423d976769eeda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:50 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe65335-caa6-4a9f-a866-8c92b599085e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:50 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe65335-caa6-4a9f-a866-8c92b599085e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:50 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff9292b-19cd-442b-9389-10010f1fd2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:50 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff9292b-19cd-442b-9389-10010f1fd2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aaa37d0-a3be-410e-a4c5-6304971abc76', 'volume_name': 'volume-6aaa37d0-a3be-410e-a4c5-6304971abc76', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:50 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b86f157-861c-466c-a593-073b303502d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:50 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b86f157-861c-466c-a593-073b303502d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:50 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e1e8ebe-52db-448c-8c2e-37a41d87bc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:50 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Volume 6aaa37d0-a3be-410e-a4c5-6304971abc76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aaa37d0-a3be-410e-a4c5-6304971abc76', 'volume_size': 1} Nov 03 08:20:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:50 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-620608482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aaa37d0-a3be-410e-a4c5-6304971abc76,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec4114bd9fa546299aa3eaf9b67dbed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:51Z,use_quota=True,user_id='81e88dbe256a4ca7a0423d976769eeda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:20:50 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Creating volume 6aaa37d0-a3be-410e-a4c5-6304971abc76 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:20:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:50 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:50 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:50 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:20:50 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:20:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6aaa37d0-a3be-410e-a4c5-6304971abc76 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:50 devstack sudo[95590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6aaa37d0-a3be-410e-a4c5-6304971abc76 1073741824 Nov 03 08:20:50 devstack sudo[95590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:50 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-705d7827-723a-4c8d-a8db-1c309214463b tempest-GroupsV320Test-1245683875 None] Group tempest-GroupsV320Test-Group-1239166182: creating Nov 03 08:20:50 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-705d7827-723a-4c8d-a8db-1c309214463b tempest-GroupsV320Test-1245683875 None] Group tempest-GroupsV320Test-Group-1239166182: created successfully Nov 03 08:20:50 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-705d7827-723a-4c8d-a8db-1c309214463b tempest-GroupsV320Test-1245683875 None] Create group completed successfully. Nov 03 08:20:51 devstack sudo[95590]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6aaa37d0-a3be-410e-a4c5-6304971abc76 1073741824" returned: 0 in 0.554s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:51 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-6c0732ad-d679-436b-8d15-d582f396113a tempest-GroupsTest-868371497 None] Update group completed successfully. Nov 03 08:20:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6aaa37d0-a3be-410e-a4c5-6304971abc76 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:51 devstack sudo[95596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6aaa37d0-a3be-410e-a4c5-6304971abc76 Nov 03 08:20:51 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:51 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6aaa37d0-a3be-410e-a4c5-6304971abc76" returned: 0 in 0.311s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:51 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:20:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e1e8ebe-52db-448c-8c2e-37a41d87bc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aaa37d0-a3be-410e-a4c5-6304971abc76', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e1538e-5b22-4ce5-806b-0e9309f4a96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:51 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Volume volume-6aaa37d0-a3be-410e-a4c5-6304971abc76 (6aaa37d0-a3be-410e-a4c5-6304971abc76): created successfully Nov 03 08:20:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e1538e-5b22-4ce5-806b-0e9309f4a96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Flow 'volume_create_manager' (6e88d118-0335-45da-9209-14adff6b2610) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:20:51 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-9477a717-99bd-470d-b7d7-ba0017c95d2a tempest-VolumesListTestJSON-1349886076 None] Created volume successfully. Nov 03 08:20:52 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-2a2ccfc4-19c2-42e3-96e6-bf180468503e tempest-GroupsV320Test-1245683875 None] Created reservations ['6622f942-6452-455d-9301-7b2fc2781394'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:20:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2a2ccfc4-19c2-42e3-96e6-bf180468503e tempest-GroupsV320Test-1245683875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2a2ccfc4-19c2-42e3-96e6-bf180468503e tempest-GroupsV320Test-1245683875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:52 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2a2ccfc4-19c2-42e3-96e6-bf180468503e tempest-GroupsV320Test-1245683875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:52 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2a2ccfc4-19c2-42e3-96e6-bf180468503e tempest-GroupsV320Test-1245683875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2a2ccfc4-19c2-42e3-96e6-bf180468503e tempest-GroupsV320Test-1245683875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2a2ccfc4-19c2-42e3-96e6-bf180468503e tempest-GroupsV320Test-1245683875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:52 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:20:52 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8293be1a-9a83-4e13-935b-e1cc5f823c85 tempest-GroupsTest-868371497 None] Acquiring lock "cinder-quobyte-1b4b2398-a330-4841-9cf1-f806d49fa31a" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8293be1a-9a83-4e13-935b-e1cc5f823c85 tempest-GroupsTest-868371497 None] Lock "cinder-quobyte-1b4b2398-a330-4841-9cf1-f806d49fa31a" acquired by "delete_volume" :: waited 0.048s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bdf4b2-b919-4852-b10d-d19d0dabd251]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8293be1a-9a83-4e13-935b-e1cc5f823c85 tempest-GroupsTest-868371497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b4b2398-a330-4841-9cf1-f806d49fa31a {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:53 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2a2ccfc4-19c2-42e3-96e6-bf180468503e tempest-GroupsV320Test-1245683875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.414s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-2a2ccfc4-19c2-42e3-96e6-bf180468503e tempest-GroupsV320Test-1245683875 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:20:53 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-2a2ccfc4-19c2-42e3-96e6-bf180468503e tempest-GroupsV320Test-1245683875 None] Delete group completed successfully. Nov 03 08:20:53 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b4b2398-a330-4841-9cf1-f806d49fa31a Nov 03 08:20:53 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Flow 'volume_create_manager' (e3d51682-c1d0-4556-b12f-a6ba43000112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b57b438b-a1e1-44d2-94ce-e9d0faed56a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b57b438b-a1e1-44d2-94ce-e9d0faed56a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1236984425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8463f62b-2601-4d8d-be5c-b6359320fb99,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec4114bd9fa546299aa3eaf9b67dbed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:53Z,use_quota=True,user_id='81e88dbe256a4ca7a0423d976769eeda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d94eab78-feee-466e-8749-5beb090dbd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d94eab78-feee-466e-8749-5beb090dbd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe0c3395-9865-4f9e-9743-510885f48917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe0c3395-9865-4f9e-9743-510885f48917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8463f62b-2601-4d8d-be5c-b6359320fb99', 'volume_name': 'volume-8463f62b-2601-4d8d-be5c-b6359320fb99', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f01514c-050b-4149-8636-bc5b21e8a0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f01514c-050b-4149-8636-bc5b21e8a0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7819930e-850e-4c82-901a-b2d4a6502746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:53 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Volume 8463f62b-2601-4d8d-be5c-b6359320fb99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8463f62b-2601-4d8d-be5c-b6359320fb99', 'volume_size': 1} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1236984425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8463f62b-2601-4d8d-be5c-b6359320fb99,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec4114bd9fa546299aa3eaf9b67dbed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:53Z,use_quota=True,user_id='81e88dbe256a4ca7a0423d976769eeda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Creating volume 8463f62b-2601-4d8d-be5c-b6359320fb99 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:20:53 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8463f62b-2601-4d8d-be5c-b6359320fb99 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:53 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8293be1a-9a83-4e13-935b-e1cc5f823c85 tempest-GroupsTest-868371497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b4b2398-a330-4841-9cf1-f806d49fa31a" returned: 0 in 0.453s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8293be1a-9a83-4e13-935b-e1cc5f823c85 tempest-GroupsTest-868371497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b4b2398-a330-4841-9cf1-f806d49fa31a {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:53 devstack sudo[95609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8463f62b-2601-4d8d-be5c-b6359320fb99 1073741824 Nov 03 08:20:53 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:53 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b4b2398-a330-4841-9cf1-f806d49fa31a Nov 03 08:20:53 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:53 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8293be1a-9a83-4e13-935b-e1cc5f823c85 tempest-GroupsTest-868371497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b4b2398-a330-4841-9cf1-f806d49fa31a" returned: 0 in 0.297s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8293be1a-9a83-4e13-935b-e1cc5f823c85 tempest-GroupsTest-868371497 None] Lock "cinder-quobyte-1b4b2398-a330-4841-9cf1-f806d49fa31a" released by "delete_volume" :: held 0.827s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8293be1a-9a83-4e13-935b-e1cc5f823c85 tempest-GroupsTest-868371497 None] Acquiring lock "cinder-quobyte-be8f903f-02c9-4066-82b4-309a652f9663" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8293be1a-9a83-4e13-935b-e1cc5f823c85 tempest-GroupsTest-868371497 None] Lock "cinder-quobyte-be8f903f-02c9-4066-82b4-309a652f9663" acquired by "delete_volume" :: waited 0.018s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[53326671-cfbc-43bd-9334-4162be03846d]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:20:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8293be1a-9a83-4e13-935b-e1cc5f823c85 tempest-GroupsTest-868371497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-be8f903f-02c9-4066-82b4-309a652f9663 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:54 devstack sudo[95618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-be8f903f-02c9-4066-82b4-309a652f9663 Nov 03 08:20:54 devstack sudo[95618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:54 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8463f62b-2601-4d8d-be5c-b6359320fb99 1073741824" returned: 0 in 0.574s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8463f62b-2601-4d8d-be5c-b6359320fb99 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:54 devstack sudo[95620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8463f62b-2601-4d8d-be5c-b6359320fb99 Nov 03 08:20:54 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:54 devstack sudo[95618]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8293be1a-9a83-4e13-935b-e1cc5f823c85 tempest-GroupsTest-868371497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-be8f903f-02c9-4066-82b4-309a652f9663" returned: 0 in 0.535s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8293be1a-9a83-4e13-935b-e1cc5f823c85 tempest-GroupsTest-868371497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-be8f903f-02c9-4066-82b4-309a652f9663 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:54 devstack sudo[95625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-be8f903f-02c9-4066-82b4-309a652f9663 Nov 03 08:20:54 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:54 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8463f62b-2601-4d8d-be5c-b6359320fb99" returned: 0 in 0.400s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:20:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:54 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=174,cinder:INSERT=40,cinder:UPDATE=192,cinder:DELETE=14 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:20:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7819930e-850e-4c82-901a-b2d4a6502746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8463f62b-2601-4d8d-be5c-b6359320fb99', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a500a925-75cb-4cf9-b625-7eca922aa1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:54 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=175,cinder:UPDATE=204,cinder:INSERT=45,cinder:DELETE=11 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:20:54 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Volume volume-8463f62b-2601-4d8d-be5c-b6359320fb99 (8463f62b-2601-4d8d-be5c-b6359320fb99): created successfully Nov 03 08:20:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a500a925-75cb-4cf9-b625-7eca922aa1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Flow 'volume_create_manager' (e3d51682-c1d0-4556-b12f-a6ba43000112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:20:54 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-7243b3fe-8d90-4da7-ae09-475aa1c1048c tempest-VolumesListTestJSON-1349886076 None] Created volume successfully. Nov 03 08:20:54 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8293be1a-9a83-4e13-935b-e1cc5f823c85 tempest-GroupsTest-868371497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-be8f903f-02c9-4066-82b4-309a652f9663" returned: 0 in 0.305s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:54 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8293be1a-9a83-4e13-935b-e1cc5f823c85 tempest-GroupsTest-868371497 None] Lock "cinder-quobyte-be8f903f-02c9-4066-82b4-309a652f9663" released by "delete_volume" :: held 0.902s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:20:54 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-8293be1a-9a83-4e13-935b-e1cc5f823c85 tempest-GroupsTest-868371497 None] Created reservations ['8e1942b9-a8d1-480b-9673-ea5bf956d037'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:20:54 devstack cinder-volume[86801]: WARNING cinder.quota [None req-8293be1a-9a83-4e13-935b-e1cc5f823c85 tempest-GroupsTest-868371497 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1246842035 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1246842035, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:20:54 devstack cinder-volume[86801]: WARNING cinder.quota [None req-8293be1a-9a83-4e13-935b-e1cc5f823c85 tempest-GroupsTest-868371497 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1246842035 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1246842035, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:20:54 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-8293be1a-9a83-4e13-935b-e1cc5f823c85 tempest-GroupsTest-868371497 None] Created reservations ['4aa8b322-7645-496e-86bd-b94307e1bf99', '25b95d83-ae20-4025-a9b4-0140cea010df', 'ca4d3353-6036-4375-80f4-c067b6d91b64', '8458ff87-bbf9-49b7-b045-64f7a78a607b'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:20:55 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-8293be1a-9a83-4e13-935b-e1cc5f823c85 tempest-GroupsTest-868371497 None] Created reservations ['b289c2c7-2a48-4c41-bb9b-5fd8927bd9b4', '20f8bd98-c10b-4aee-a6e6-47acb9fef912', '65818e55-c6e2-4d1c-849d-4fc399e5980c', '244d74e5-02e8-47d0-b97b-11f231f2ba60'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:20:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8293be1a-9a83-4e13-935b-e1cc5f823c85 tempest-GroupsTest-868371497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8293be1a-9a83-4e13-935b-e1cc5f823c85 tempest-GroupsTest-868371497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:55 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8293be1a-9a83-4e13-935b-e1cc5f823c85 tempest-GroupsTest-868371497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:55 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8293be1a-9a83-4e13-935b-e1cc5f823c85 tempest-GroupsTest-868371497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8293be1a-9a83-4e13-935b-e1cc5f823c85 tempest-GroupsTest-868371497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8293be1a-9a83-4e13-935b-e1cc5f823c85 tempest-GroupsTest-868371497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:55 devstack sudo[95629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:20:55 devstack sudo[95629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:55 devstack sudo[95629]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8293be1a-9a83-4e13-935b-e1cc5f823c85 tempest-GroupsTest-868371497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.357s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:55 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-8293be1a-9a83-4e13-935b-e1cc5f823c85 tempest-GroupsTest-868371497 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:20:55 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-8293be1a-9a83-4e13-935b-e1cc5f823c85 tempest-GroupsTest-868371497 None] Delete group completed successfully. Nov 03 08:20:56 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:20:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Flow 'volume_create_manager' (97057c54-6c9f-4950-8083-051b6aa90f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:20:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e0119b8-23d4-4ed9-8fed-2b0a9dd58452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e0119b8-23d4-4ed9-8fed-2b0a9dd58452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-257970901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f430c93-eecf-48ba-ab9c-6a27b2b3779f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec4114bd9fa546299aa3eaf9b67dbed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:56Z,use_quota=True,user_id='81e88dbe256a4ca7a0423d976769eeda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07999168-1dd7-4ac5-a590-d4766318e7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07999168-1dd7-4ac5-a590-d4766318e7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (818d5894-900e-405d-b469-34844052e715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (818d5894-900e-405d-b469-34844052e715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f430c93-eecf-48ba-ab9c-6a27b2b3779f', 'volume_name': 'volume-3f430c93-eecf-48ba-ab9c-6a27b2b3779f', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5865b04-029a-44e7-9e63-974e1436cc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5865b04-029a-44e7-9e63-974e1436cc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4505721-df67-4874-8116-04298fbe9920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:56 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Volume 3f430c93-eecf-48ba-ab9c-6a27b2b3779f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f430c93-eecf-48ba-ab9c-6a27b2b3779f', 'volume_size': 1} Nov 03 08:20:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:56 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-257970901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f430c93-eecf-48ba-ab9c-6a27b2b3779f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec4114bd9fa546299aa3eaf9b67dbed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:20:56Z,use_quota=True,user_id='81e88dbe256a4ca7a0423d976769eeda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:20:56 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Creating volume 3f430c93-eecf-48ba-ab9c-6a27b2b3779f {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:20:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:20:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:20:56 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:20:56 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:20:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:56 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:20:56 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:20:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3f430c93-eecf-48ba-ab9c-6a27b2b3779f 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:56 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3f430c93-eecf-48ba-ab9c-6a27b2b3779f 1073741824 Nov 03 08:20:56 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:56 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3f430c93-eecf-48ba-ab9c-6a27b2b3779f 1073741824" returned: 0 in 0.580s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3f430c93-eecf-48ba-ab9c-6a27b2b3779f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:20:57 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3f430c93-eecf-48ba-ab9c-6a27b2b3779f Nov 03 08:20:57 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:20:57 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Nov 03 08:20:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3f430c93-eecf-48ba-ab9c-6a27b2b3779f" returned: 0 in 0.306s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:20:57 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:20:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:20:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4505721-df67-4874-8116-04298fbe9920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f430c93-eecf-48ba-ab9c-6a27b2b3779f', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93dd3849-c6e0-4dc5-8c8f-a56057297c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:20:57 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Volume volume-3f430c93-eecf-48ba-ab9c-6a27b2b3779f (3f430c93-eecf-48ba-ab9c-6a27b2b3779f): created successfully Nov 03 08:20:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93dd3849-c6e0-4dc5-8c8f-a56057297c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:20:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Flow 'volume_create_manager' (97057c54-6c9f-4950-8083-051b6aa90f1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:20:57 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-8464f651-c3b1-4390-8c0e-717348bf0442 tempest-VolumesListTestJSON-1349886076 None] Created volume successfully. Nov 03 08:21:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9710760e-fdd0-44c0-b1cc-0dab36504aca tempest-VolumesListTestJSON-1349886076 None] Acquiring lock "cinder-3f430c93-eecf-48ba-ab9c-6a27b2b3779f-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9710760e-fdd0-44c0-b1cc-0dab36504aca tempest-VolumesListTestJSON-1349886076 None] Lock "cinder-3f430c93-eecf-48ba-ab9c-6a27b2b3779f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9710760e-fdd0-44c0-b1cc-0dab36504aca tempest-VolumesListTestJSON-1349886076 None] Acquiring lock "cinder-quobyte-3f430c93-eecf-48ba-ab9c-6a27b2b3779f" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9710760e-fdd0-44c0-b1cc-0dab36504aca tempest-VolumesListTestJSON-1349886076 None] Lock "cinder-quobyte-3f430c93-eecf-48ba-ab9c-6a27b2b3779f" acquired by "delete_volume" :: waited 0.027s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:01 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[745f05e1-8474-4eea-b279-f61b137e768d]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9710760e-fdd0-44c0-b1cc-0dab36504aca tempest-VolumesListTestJSON-1349886076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3f430c93-eecf-48ba-ab9c-6a27b2b3779f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:01 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3f430c93-eecf-48ba-ab9c-6a27b2b3779f Nov 03 08:21:01 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:01 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9710760e-fdd0-44c0-b1cc-0dab36504aca tempest-VolumesListTestJSON-1349886076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3f430c93-eecf-48ba-ab9c-6a27b2b3779f" returned: 0 in 0.561s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9710760e-fdd0-44c0-b1cc-0dab36504aca tempest-VolumesListTestJSON-1349886076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3f430c93-eecf-48ba-ab9c-6a27b2b3779f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:02 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3f430c93-eecf-48ba-ab9c-6a27b2b3779f Nov 03 08:21:02 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:02 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9710760e-fdd0-44c0-b1cc-0dab36504aca tempest-VolumesListTestJSON-1349886076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3f430c93-eecf-48ba-ab9c-6a27b2b3779f" returned: 0 in 0.382s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:02 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9710760e-fdd0-44c0-b1cc-0dab36504aca tempest-VolumesListTestJSON-1349886076 None] Lock "cinder-quobyte-3f430c93-eecf-48ba-ab9c-6a27b2b3779f" released by "delete_volume" :: held 1.019s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:02 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-9710760e-fdd0-44c0-b1cc-0dab36504aca tempest-VolumesListTestJSON-1349886076 None] Created reservations ['9437cabd-083e-4d31-b800-899282f97827', 'f53bb624-ea3f-4dd7-ab32-edf47968bf99', '53510b5c-2360-4615-8ca9-c3d73cfe7152', '8bf40249-0c05-493e-9066-f6f59284186d'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:21:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9710760e-fdd0-44c0-b1cc-0dab36504aca tempest-VolumesListTestJSON-1349886076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9710760e-fdd0-44c0-b1cc-0dab36504aca tempest-VolumesListTestJSON-1349886076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:02 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9710760e-fdd0-44c0-b1cc-0dab36504aca tempest-VolumesListTestJSON-1349886076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:21:02 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9710760e-fdd0-44c0-b1cc-0dab36504aca tempest-VolumesListTestJSON-1349886076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:21:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9710760e-fdd0-44c0-b1cc-0dab36504aca tempest-VolumesListTestJSON-1349886076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9710760e-fdd0-44c0-b1cc-0dab36504aca tempest-VolumesListTestJSON-1349886076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:02 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:21:02 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:02 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9710760e-fdd0-44c0-b1cc-0dab36504aca tempest-VolumesListTestJSON-1349886076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.319s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:02 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-9710760e-fdd0-44c0-b1cc-0dab36504aca tempest-VolumesListTestJSON-1349886076 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:21:02 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-9710760e-fdd0-44c0-b1cc-0dab36504aca tempest-VolumesListTestJSON-1349886076 None] Deleted volume successfully. Nov 03 08:21:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9710760e-fdd0-44c0-b1cc-0dab36504aca tempest-VolumesListTestJSON-1349886076 None] Lock "cinder-3f430c93-eecf-48ba-ab9c-6a27b2b3779f-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-36a8f597-0a69-433f-b691-181ba384d039 tempest-VolumesListTestJSON-1349886076 None] Acquiring lock "cinder-8463f62b-2601-4d8d-be5c-b6359320fb99-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:03 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:21:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:21:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:21:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-36a8f597-0a69-433f-b691-181ba384d039 tempest-VolumesListTestJSON-1349886076 None] Lock "cinder-8463f62b-2601-4d8d-be5c-b6359320fb99-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:03 devstack sudo[95689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:21:03 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-36a8f597-0a69-433f-b691-181ba384d039 tempest-VolumesListTestJSON-1349886076 None] Acquiring lock "cinder-quobyte-8463f62b-2601-4d8d-be5c-b6359320fb99" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-36a8f597-0a69-433f-b691-181ba384d039 tempest-VolumesListTestJSON-1349886076 None] Lock "cinder-quobyte-8463f62b-2601-4d8d-be5c-b6359320fb99" acquired by "delete_volume" :: waited 0.017s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:03 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4c4750-8d66-44cd-bdf5-35a660917c31]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-36a8f597-0a69-433f-b691-181ba384d039 tempest-VolumesListTestJSON-1349886076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8463f62b-2601-4d8d-be5c-b6359320fb99 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:04 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.338s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:04 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:21:04 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8463f62b-2601-4d8d-be5c-b6359320fb99 Nov 03 08:21:04 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:04 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager._thread_info {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:21:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread count: 29 {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 08:21:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread info: [<_MainThread(MainThread, started 139707544170624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 08:21:04 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-36a8f597-0a69-433f-b691-181ba384d039 tempest-VolumesListTestJSON-1349886076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8463f62b-2601-4d8d-be5c-b6359320fb99" returned: 0 in 0.451s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-36a8f597-0a69-433f-b691-181ba384d039 tempest-VolumesListTestJSON-1349886076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8463f62b-2601-4d8d-be5c-b6359320fb99 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:04 devstack sudo[95703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8463f62b-2601-4d8d-be5c-b6359320fb99 Nov 03 08:21:04 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:04 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-36a8f597-0a69-433f-b691-181ba384d039 tempest-VolumesListTestJSON-1349886076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8463f62b-2601-4d8d-be5c-b6359320fb99" returned: 0 in 0.270s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-36a8f597-0a69-433f-b691-181ba384d039 tempest-VolumesListTestJSON-1349886076 None] Lock "cinder-quobyte-8463f62b-2601-4d8d-be5c-b6359320fb99" released by "delete_volume" :: held 0.805s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:04 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-36a8f597-0a69-433f-b691-181ba384d039 tempest-VolumesListTestJSON-1349886076 None] Created reservations ['79678124-7bcc-44cd-8cca-1ad63b0c9583', 'f641fc0f-33bc-45e9-a758-b50116c2fce6', '183af31b-640f-4e83-8cd2-c41b94cf8d33', '0c73c406-bd9a-4ab2-937a-2ef99cc3348a'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:21:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-36a8f597-0a69-433f-b691-181ba384d039 tempest-VolumesListTestJSON-1349886076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-36a8f597-0a69-433f-b691-181ba384d039 tempest-VolumesListTestJSON-1349886076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-36a8f597-0a69-433f-b691-181ba384d039 tempest-VolumesListTestJSON-1349886076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:21:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-36a8f597-0a69-433f-b691-181ba384d039 tempest-VolumesListTestJSON-1349886076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:21:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-36a8f597-0a69-433f-b691-181ba384d039 tempest-VolumesListTestJSON-1349886076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-36a8f597-0a69-433f-b691-181ba384d039 tempest-VolumesListTestJSON-1349886076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:04 devstack sudo[95706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:21:04 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1e59a1fe-07f8-4f58-85ff-2eb2774454c5 tempest-VolumesListTestJSON-1349886076 None] Acquiring lock "cinder-6aaa37d0-a3be-410e-a4c5-6304971abc76-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1e59a1fe-07f8-4f58-85ff-2eb2774454c5 tempest-VolumesListTestJSON-1349886076 None] Lock "cinder-6aaa37d0-a3be-410e-a4c5-6304971abc76-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1e59a1fe-07f8-4f58-85ff-2eb2774454c5 tempest-VolumesListTestJSON-1349886076 None] Acquiring lock "cinder-quobyte-6aaa37d0-a3be-410e-a4c5-6304971abc76" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1e59a1fe-07f8-4f58-85ff-2eb2774454c5 tempest-VolumesListTestJSON-1349886076 None] Lock "cinder-quobyte-6aaa37d0-a3be-410e-a4c5-6304971abc76" acquired by "delete_volume" :: waited 0.019s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:05 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-36a8f597-0a69-433f-b691-181ba384d039 tempest-VolumesListTestJSON-1349886076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.337s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:05 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-36a8f597-0a69-433f-b691-181ba384d039 tempest-VolumesListTestJSON-1349886076 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:21:05 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-36a8f597-0a69-433f-b691-181ba384d039 tempest-VolumesListTestJSON-1349886076 None] Deleted volume successfully. Nov 03 08:21:05 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de8b2e7-6bc2-463b-ac40-7ea18505f3ef]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1e59a1fe-07f8-4f58-85ff-2eb2774454c5 tempest-VolumesListTestJSON-1349886076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6aaa37d0-a3be-410e-a4c5-6304971abc76 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-36a8f597-0a69-433f-b691-181ba384d039 tempest-VolumesListTestJSON-1349886076 None] Lock "cinder-8463f62b-2601-4d8d-be5c-b6359320fb99-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:05 devstack sudo[95709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6aaa37d0-a3be-410e-a4c5-6304971abc76 Nov 03 08:21:05 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:05 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1e59a1fe-07f8-4f58-85ff-2eb2774454c5 tempest-VolumesListTestJSON-1349886076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6aaa37d0-a3be-410e-a4c5-6304971abc76" returned: 0 in 0.426s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1e59a1fe-07f8-4f58-85ff-2eb2774454c5 tempest-VolumesListTestJSON-1349886076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6aaa37d0-a3be-410e-a4c5-6304971abc76 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:05 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6aaa37d0-a3be-410e-a4c5-6304971abc76 Nov 03 08:21:05 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:05 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1e59a1fe-07f8-4f58-85ff-2eb2774454c5 tempest-VolumesListTestJSON-1349886076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6aaa37d0-a3be-410e-a4c5-6304971abc76" returned: 0 in 0.328s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1e59a1fe-07f8-4f58-85ff-2eb2774454c5 tempest-VolumesListTestJSON-1349886076 None] Lock "cinder-quobyte-6aaa37d0-a3be-410e-a4c5-6304971abc76" released by "delete_volume" :: held 0.817s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:06 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-1e59a1fe-07f8-4f58-85ff-2eb2774454c5 tempest-VolumesListTestJSON-1349886076 None] Created reservations ['2b0347ff-a6ac-4e12-8fd3-14181be44598', '2a660391-5a58-459c-8def-39fd778115bf', '426d28a5-2f07-490e-87e1-61c8f120ebbb', '7d046c2a-d423-480f-bff7-fb6c13664a17'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:21:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1e59a1fe-07f8-4f58-85ff-2eb2774454c5 tempest-VolumesListTestJSON-1349886076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1e59a1fe-07f8-4f58-85ff-2eb2774454c5 tempest-VolumesListTestJSON-1349886076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1e59a1fe-07f8-4f58-85ff-2eb2774454c5 tempest-VolumesListTestJSON-1349886076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:21:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1e59a1fe-07f8-4f58-85ff-2eb2774454c5 tempest-VolumesListTestJSON-1349886076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:21:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1e59a1fe-07f8-4f58-85ff-2eb2774454c5 tempest-VolumesListTestJSON-1349886076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1e59a1fe-07f8-4f58-85ff-2eb2774454c5 tempest-VolumesListTestJSON-1349886076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:06 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:21:06 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:06 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1e59a1fe-07f8-4f58-85ff-2eb2774454c5 tempest-VolumesListTestJSON-1349886076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.290s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:06 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-1e59a1fe-07f8-4f58-85ff-2eb2774454c5 tempest-VolumesListTestJSON-1349886076 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:21:06 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-1e59a1fe-07f8-4f58-85ff-2eb2774454c5 tempest-VolumesListTestJSON-1349886076 None] Deleted volume successfully. Nov 03 08:21:06 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1e59a1fe-07f8-4f58-85ff-2eb2774454c5 tempest-VolumesListTestJSON-1349886076 None] Lock "cinder-6aaa37d0-a3be-410e-a4c5-6304971abc76-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:12 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:21:12 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Flow 'volume_create_manager' (3577d1e0-3d00-4f38-a5ae-eeb6dc268a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:21:12 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d066510-7eaa-4ed3-a490-172df73ecc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:12 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d066510-7eaa-4ed3-a490-172df73ecc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-810055600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27be7d92-d2e1-49c2-b290-c224090891db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eef9cf4671b647ff901078c60862a272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:21:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:21:12Z,use_quota=True,user_id='4141a91a909649feb6b39b9c1a2f14e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:12 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (720e6c06-85ea-4d5d-96e6-c854c36449fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:12 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (720e6c06-85ea-4d5d-96e6-c854c36449fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:12 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297f975e-5dad-4fa3-998a-098a34ec4ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:12 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297f975e-5dad-4fa3-998a-098a34ec4ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27be7d92-d2e1-49c2-b290-c224090891db', 'volume_name': 'volume-27be7d92-d2e1-49c2-b290-c224090891db', 'volume_size': 2}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:12 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (610dddfe-e2cf-4ba5-9869-88777ba49577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:12 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (610dddfe-e2cf-4ba5-9869-88777ba49577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:12 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0404fb7-7cc3-485f-87e9-bd2ea9619720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:12 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Volume 27be7d92-d2e1-49c2-b290-c224090891db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27be7d92-d2e1-49c2-b290-c224090891db', 'volume_size': 2} Nov 03 08:21:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:12 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-810055600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27be7d92-d2e1-49c2-b290-c224090891db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eef9cf4671b647ff901078c60862a272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:21:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:21:12Z,use_quota=True,user_id='4141a91a909649feb6b39b9c1a2f14e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:21:12 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Creating volume 27be7d92-d2e1-49c2-b290-c224090891db {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:21:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:12 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:21:12 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:21:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:12 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:21:12 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:21:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db 2147483648 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:12 devstack sudo[95723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db 2147483648 Nov 03 08:21:12 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:13 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db 2147483648" returned: 0 in 0.708s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:13 devstack sudo[95729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db Nov 03 08:21:13 devstack sudo[95729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:13 devstack sudo[95729]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db" returned: 0 in 0.342s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0404fb7-7cc3-485f-87e9-bd2ea9619720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27be7d92-d2e1-49c2-b290-c224090891db', 'volume_size': 2}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c86af7-da35-49d3-b77e-7ead02e53cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:13 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Volume volume-27be7d92-d2e1-49c2-b290-c224090891db (27be7d92-d2e1-49c2-b290-c224090891db): created successfully Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c86af7-da35-49d3-b77e-7ead02e53cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Flow 'volume_create_manager' (3577d1e0-3d00-4f38-a5ae-eeb6dc268a8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:21:13 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-9d7a62da-0e6f-4932-aa01-c19a9de4df40 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Created volume successfully. Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Flow 'volume_create_manager' (1509b07e-e553-4e21-86d8-567808277aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b48199-c0f7-4e8e-92c7-506fd419d91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b48199-c0f7-4e8e-92c7-506fd419d91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1806526784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b649550-d019-4ffa-bff6-338be3c86033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4a519cd93440d4b4fad13f4d3a199a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:21:14Z,use_quota=True,user_id='aa01f056669446a1ab5002b5719a9bd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918aec8c-c747-4289-a9cc-ed1bc607c083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918aec8c-c747-4289-a9cc-ed1bc607c083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3f2edb-613a-465d-b041-7d4c8d09a97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3f2edb-613a-465d-b041-7d4c8d09a97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b649550-d019-4ffa-bff6-338be3c86033', 'volume_name': 'volume-1b649550-d019-4ffa-bff6-338be3c86033', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb99b4e-53c7-4e1c-a0a8-fa929c1cffde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb99b4e-53c7-4e1c-a0a8-fa929c1cffde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a1c6dc3-4bc0-4366-b95e-f188643c6751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:13 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Volume 1b649550-d019-4ffa-bff6-338be3c86033: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b649550-d019-4ffa-bff6-338be3c86033', 'volume_size': 1} Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1806526784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b649550-d019-4ffa-bff6-338be3c86033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4a519cd93440d4b4fad13f4d3a199a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:21:14Z,use_quota=True,user_id='aa01f056669446a1ab5002b5719a9bd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Creating volume 1b649550-d019-4ffa-bff6-338be3c86033 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:21:13 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:21:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:13 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033 1073741824 Nov 03 08:21:13 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Flow 'volume_create_manager' (4b837b1c-f610-4e25-8827-673b2c6a5e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ecc0e0-01f7-4edf-8eaa-48092e367786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ecc0e0-01f7-4edf-8eaa-48092e367786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1988769724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c9a3a9-915d-4948-a597-c03dae9bc939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0dcedbd46474722ae2fec24dae5ef97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:21:14Z,use_quota=True,user_id='7268c9a78b504eea916c1fbe38889780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d8f0642-144d-46ed-b10c-0f6e8f85fc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d8f0642-144d-46ed-b10c-0f6e8f85fc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a31e534-10d7-4ff6-b855-85348fcde3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a31e534-10d7-4ff6-b855-85348fcde3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95c9a3a9-915d-4948-a597-c03dae9bc939', 'volume_name': 'volume-95c9a3a9-915d-4948-a597-c03dae9bc939', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44dbeef4-fb47-4ede-91ff-ca10bc42baed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44dbeef4-fb47-4ede-91ff-ca10bc42baed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b8bdd57-0ca1-4913-9bbe-e908fa502131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:14 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Volume 95c9a3a9-915d-4948-a597-c03dae9bc939: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95c9a3a9-915d-4948-a597-c03dae9bc939', 'volume_size': 1} Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:14 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033 1073741824" returned: 0 in 0.560s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:14 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033 Nov 03 08:21:14 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-118fb1a3-2cbd-4dd7-be3e-467c7aa745e6 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:14 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033" returned: 0 in 0.284s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.563s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1988769724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c9a3a9-915d-4948-a597-c03dae9bc939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0dcedbd46474722ae2fec24dae5ef97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:21:14Z,use_quota=True,user_id='7268c9a78b504eea916c1fbe38889780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Creating volume 95c9a3a9-915d-4948-a597-c03dae9bc939 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:21:14 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-95c9a3a9-915d-4948-a597-c03dae9bc939 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a1c6dc3-4bc0-4366-b95e-f188643c6751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b649550-d019-4ffa-bff6-338be3c86033', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:14 devstack sudo[95741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-95c9a3a9-915d-4948-a597-c03dae9bc939 1073741824 Nov 03 08:21:14 devstack sudo[95741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84b834b0-34e9-470c-b192-8b06abfbe8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:14 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Volume volume-1b649550-d019-4ffa-bff6-338be3c86033 (1b649550-d019-4ffa-bff6-338be3c86033): created successfully Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84b834b0-34e9-470c-b192-8b06abfbe8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Flow 'volume_create_manager' (1509b07e-e553-4e21-86d8-567808277aa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:21:14 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-5c1c5502-cdfd-4f84-8808-86febec0dcbc tempest-SnapshotsActionsTest-14198360 None] Created volume successfully. Nov 03 08:21:15 devstack sudo[95741]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-95c9a3a9-915d-4948-a597-c03dae9bc939 1073741824" returned: 0 in 0.472s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-95c9a3a9-915d-4948-a597-c03dae9bc939 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:15 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-95c9a3a9-915d-4948-a597-c03dae9bc939 Nov 03 08:21:15 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:15 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-95c9a3a9-915d-4948-a597-c03dae9bc939" returned: 0 in 0.257s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:15 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:21:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-118fb1a3-2cbd-4dd7-be3e-467c7aa745e6 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.982s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:15 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-118fb1a3-2cbd-4dd7-be3e-467c7aa745e6 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Creating offline snapshot eb530779-c1f2-468a-9342-50204f47d53f of volume 27be7d92-d2e1-49c2-b290-c224090891db {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:21:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b8bdd57-0ca1-4913-9bbe-e908fa502131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95c9a3a9-915d-4948-a597-c03dae9bc939', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb2e053-0b58-4d0f-8569-2a897f0e0320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:15 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e71d04-5059-463c-a48b-6749d254bd18]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-118fb1a3-2cbd-4dd7-be3e-467c7aa745e6 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:15 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Volume volume-95c9a3a9-915d-4948-a597-c03dae9bc939 (95c9a3a9-915d-4948-a597-c03dae9bc939): created successfully Nov 03 08:21:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb2e053-0b58-4d0f-8569-2a897f0e0320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Flow 'volume_create_manager' (4b837b1c-f610-4e25-8827-673b2c6a5e8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:21:15 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-c0a47e88-5357-436c-928e-4a05c03a1364 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Created volume successfully. Nov 03 08:21:15 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db Nov 03 08:21:15 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-695d1f0b-753a-44eb-8a8d-9f53c89d0b63 tempest-SnapshotsActionsTest-14198360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:16 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-118fb1a3-2cbd-4dd7-be3e-467c7aa745e6 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db" returned: 0 in 0.491s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-118fb1a3-2cbd-4dd7-be3e-467c7aa745e6 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db.eb530779-c1f2-468a-9342-50204f47d53f 2G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:16 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db.eb530779-c1f2-468a-9342-50204f47d53f 2G Nov 03 08:21:16 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:16 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-72c3ad1e-03d1-49cf-b696-594f1c55b121 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Acquiring lock "cinder-95c9a3a9-915d-4948-a597-c03dae9bc939-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:16 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-72c3ad1e-03d1-49cf-b696-594f1c55b121 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Lock "cinder-95c9a3a9-915d-4948-a597-c03dae9bc939-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:16 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-72c3ad1e-03d1-49cf-b696-594f1c55b121 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Acquiring lock "cinder-quobyte-95c9a3a9-915d-4948-a597-c03dae9bc939" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:16 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-72c3ad1e-03d1-49cf-b696-594f1c55b121 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Lock "cinder-quobyte-95c9a3a9-915d-4948-a597-c03dae9bc939" acquired by "delete_volume" :: waited 0.022s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:16 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc8e030-5c4c-4e9a-aa31-c00e9c40fc7b]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-72c3ad1e-03d1-49cf-b696-594f1c55b121 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-95c9a3a9-915d-4948-a597-c03dae9bc939 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:16 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-95c9a3a9-915d-4948-a597-c03dae9bc939 Nov 03 08:21:16 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:16 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-118fb1a3-2cbd-4dd7-be3e-467c7aa745e6 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db.eb530779-c1f2-468a-9342-50204f47d53f 2G" returned: 0 in 0.459s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-118fb1a3-2cbd-4dd7-be3e-467c7aa745e6 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27be7d92-d2e1-49c2-b290-c224090891db -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db.eb530779-c1f2-468a-9342-50204f47d53f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:16 devstack sudo[95764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27be7d92-d2e1-49c2-b290-c224090891db -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db.eb530779-c1f2-468a-9342-50204f47d53f Nov 03 08:21:16 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:16 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-72c3ad1e-03d1-49cf-b696-594f1c55b121 tempest-VolumeQuotasAdminTestJSON-1314438054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-95c9a3a9-915d-4948-a597-c03dae9bc939" returned: 0 in 0.399s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-72c3ad1e-03d1-49cf-b696-594f1c55b121 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-95c9a3a9-915d-4948-a597-c03dae9bc939 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:16 devstack sudo[95772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-95c9a3a9-915d-4948-a597-c03dae9bc939 Nov 03 08:21:16 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:16 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-118fb1a3-2cbd-4dd7-be3e-467c7aa745e6 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27be7d92-d2e1-49c2-b290-c224090891db -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db.eb530779-c1f2-468a-9342-50204f47d53f" returned: 0 in 0.333s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:16 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-118fb1a3-2cbd-4dd7-be3e-467c7aa745e6 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db.eb530779-c1f2-468a-9342-50204f47d53f is being set with open permissions: ugo+rw Nov 03 08:21:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-118fb1a3-2cbd-4dd7-be3e-467c7aa745e6 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db.eb530779-c1f2-468a-9342-50204f47d53f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:16 devstack sudo[95774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db.eb530779-c1f2-468a-9342-50204f47d53f Nov 03 08:21:16 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:17 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-72c3ad1e-03d1-49cf-b696-594f1c55b121 tempest-VolumeQuotasAdminTestJSON-1314438054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-95c9a3a9-915d-4948-a597-c03dae9bc939" returned: 0 in 0.288s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:17 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-72c3ad1e-03d1-49cf-b696-594f1c55b121 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Lock "cinder-quobyte-95c9a3a9-915d-4948-a597-c03dae9bc939" released by "delete_volume" :: held 0.736s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:17 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-118fb1a3-2cbd-4dd7-be3e-467c7aa745e6 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db.eb530779-c1f2-468a-9342-50204f47d53f" returned: 0 in 0.256s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-118fb1a3-2cbd-4dd7-be3e-467c7aa745e6 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:17 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-72c3ad1e-03d1-49cf-b696-594f1c55b121 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Created reservations ['8c2ae135-3287-4f58-80e5-b3e4d9ed6a39', '52428355-7140-45db-960f-b9f3cd073dcc', '487566f5-10c3-4fff-9401-401540656498', '78444d76-da21-4684-b1aa-bfc8f55a205f'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:21:17 devstack sudo[95778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db.info Nov 03 08:21:17 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-72c3ad1e-03d1-49cf-b696-594f1c55b121 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-72c3ad1e-03d1-49cf-b696-594f1c55b121 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:17 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-72c3ad1e-03d1-49cf-b696-594f1c55b121 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:21:17 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-72c3ad1e-03d1-49cf-b696-594f1c55b121 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:21:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-72c3ad1e-03d1-49cf-b696-594f1c55b121 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-72c3ad1e-03d1-49cf-b696-594f1c55b121 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:17 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:21:17 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:17 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-118fb1a3-2cbd-4dd7-be3e-467c7aa745e6 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db.info" returned: 0 in 0.285s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:17 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-118fb1a3-2cbd-4dd7-be3e-467c7aa745e6 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db.info is being set with open permissions: ugo+rw Nov 03 08:21:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-118fb1a3-2cbd-4dd7-be3e-467c7aa745e6 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:17 devstack sudo[95783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db.info Nov 03 08:21:17 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:17 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-72c3ad1e-03d1-49cf-b696-594f1c55b121 tempest-VolumeQuotasAdminTestJSON-1314438054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.309s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:17 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-72c3ad1e-03d1-49cf-b696-594f1c55b121 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:21:17 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-72c3ad1e-03d1-49cf-b696-594f1c55b121 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Deleted volume successfully. Nov 03 08:21:17 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-72c3ad1e-03d1-49cf-b696-594f1c55b121 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Lock "cinder-95c9a3a9-915d-4948-a597-c03dae9bc939-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:17 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-118fb1a3-2cbd-4dd7-be3e-467c7aa745e6 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db.info" returned: 0 in 0.284s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-118fb1a3-2cbd-4dd7-be3e-467c7aa745e6 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.225s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-695d1f0b-753a-44eb-8a8d-9f53c89d0b63 tempest-SnapshotsActionsTest-14198360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.720s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:17 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-695d1f0b-753a-44eb-8a8d-9f53c89d0b63 tempest-SnapshotsActionsTest-14198360 None] Creating offline snapshot 3302045f-6c7a-483a-b471-195e91a85ccb of volume 1b649550-d019-4ffa-bff6-338be3c86033 {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:21:17 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-118fb1a3-2cbd-4dd7-be3e-467c7aa745e6 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Create snapshot completed successfully Nov 03 08:21:17 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac779be3-dd55-448d-bb50-0162beee1e46]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-695d1f0b-753a-44eb-8a8d-9f53c89d0b63 tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:18 devstack sudo[95787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033 Nov 03 08:21:18 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:18 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:21:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Flow 'volume_create_manager' (6abefea5-95e5-4a1b-b5f1-e26b13659618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:21:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b996f1bc-d395-4a7a-b75b-cee7eef3c6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b996f1bc-d395-4a7a-b75b-cee7eef3c6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1305789974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4368a006-8689-4fef-8fc1-ebc003e55448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0dcedbd46474722ae2fec24dae5ef97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:21:18Z,use_quota=True,user_id='7268c9a78b504eea916c1fbe38889780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61502d12-c73c-4a8a-8a60-db48aaf974b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61502d12-c73c-4a8a-8a60-db48aaf974b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d2d53e-75f8-4854-bb9d-2fd2847d3b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d2d53e-75f8-4854-bb9d-2fd2847d3b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4368a006-8689-4fef-8fc1-ebc003e55448', 'volume_name': 'volume-4368a006-8689-4fef-8fc1-ebc003e55448', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3292d6f6-2e9e-424e-8e4f-928c1ed1a760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3292d6f6-2e9e-424e-8e4f-928c1ed1a760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d566fea8-a0f6-408a-8f4a-19b0b54276d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:18 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Volume 4368a006-8689-4fef-8fc1-ebc003e55448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4368a006-8689-4fef-8fc1-ebc003e55448', 'volume_size': 1} Nov 03 08:21:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:18 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-695d1f0b-753a-44eb-8a8d-9f53c89d0b63 tempest-SnapshotsActionsTest-14198360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033" returned: 0 in 0.392s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-695d1f0b-753a-44eb-8a8d-9f53c89d0b63 tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:18 devstack sudo[95792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb 1G Nov 03 08:21:18 devstack sudo[95792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:18 devstack sudo[95792]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-695d1f0b-753a-44eb-8a8d-9f53c89d0b63 tempest-SnapshotsActionsTest-14198360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb 1G" returned: 0 in 0.444s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-695d1f0b-753a-44eb-8a8d-9f53c89d0b63 tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b649550-d019-4ffa-bff6-338be3c86033 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:18 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b649550-d019-4ffa-bff6-338be3c86033 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb Nov 03 08:21:18 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:19 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a1ce622c-2271-4def-bda2-26951440c5ae tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Acquiring lock "cinder-eb530779-c1f2-468a-9342-50204f47d53f-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:19 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a1ce622c-2271-4def-bda2-26951440c5ae tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Lock "cinder-eb530779-c1f2-468a-9342-50204f47d53f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:19 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a1ce622c-2271-4def-bda2-26951440c5ae tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Acquiring lock "cinder-quobyte-27be7d92-d2e1-49c2-b290-c224090891db" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:19 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a1ce622c-2271-4def-bda2-26951440c5ae tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Lock "cinder-quobyte-27be7d92-d2e1-49c2-b290-c224090891db" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:19 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a1ce622c-2271-4def-bda2-26951440c5ae tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Acquiring lock "cinder-quobyte-eb530779-c1f2-468a-9342-50204f47d53f" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:19 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a1ce622c-2271-4def-bda2-26951440c5ae tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Lock "cinder-quobyte-eb530779-c1f2-468a-9342-50204f47d53f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:19 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-a1ce622c-2271-4def-bda2-26951440c5ae tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Deleting offline snapshot eb530779-c1f2-468a-9342-50204f47d53f of volume 27be7d92-d2e1-49c2-b290-c224090891db {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:21:19 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:19 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-a1ce622c-2271-4def-bda2-26951440c5ae tempest-VolumesSnapshotNegativeTestJSON-856996451 None] snapshot_file for this snap is: volume-27be7d92-d2e1-49c2-b290-c224090891db.eb530779-c1f2-468a-9342-50204f47d53f {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:21:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-695d1f0b-753a-44eb-8a8d-9f53c89d0b63 tempest-SnapshotsActionsTest-14198360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b649550-d019-4ffa-bff6-338be3c86033 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb" returned: 0 in 0.380s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:19 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-695d1f0b-753a-44eb-8a8d-9f53c89d0b63 tempest-SnapshotsActionsTest-14198360 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb is being set with open permissions: ugo+rw Nov 03 08:21:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-695d1f0b-753a-44eb-8a8d-9f53c89d0b63 tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:19 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[95503446-0cda-4d62-81b8-ff3f1011bb04]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a1ce622c-2271-4def-bda2-26951440c5ae tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db.eb530779-c1f2-468a-9342-50204f47d53f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:19 devstack sudo[95803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb Nov 03 08:21:19 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:19 devstack sudo[95805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db.eb530779-c1f2-468a-9342-50204f47d53f Nov 03 08:21:19 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:19 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-695d1f0b-753a-44eb-8a8d-9f53c89d0b63 tempest-SnapshotsActionsTest-14198360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb" returned: 0 in 0.310s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-695d1f0b-753a-44eb-8a8d-9f53c89d0b63 tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:19 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.info Nov 03 08:21:19 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:19 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a1ce622c-2271-4def-bda2-26951440c5ae tempest-VolumesSnapshotNegativeTestJSON-856996451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db.eb530779-c1f2-468a-9342-50204f47d53f" returned: 0 in 0.413s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:19 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-a1ce622c-2271-4def-bda2-26951440c5ae tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27be7d92-d2e1-49c2-b290-c224090891db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:21:19 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[e037cf5b-bec6-4787-9db0-31828887b037]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a1ce622c-2271-4def-bda2-26951440c5ae tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:19 devstack sudo[95813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db Nov 03 08:21:19 devstack sudo[95813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:19 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-695d1f0b-753a-44eb-8a8d-9f53c89d0b63 tempest-SnapshotsActionsTest-14198360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.info" returned: 0 in 0.299s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:19 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-695d1f0b-753a-44eb-8a8d-9f53c89d0b63 tempest-SnapshotsActionsTest-14198360 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.info is being set with open permissions: ugo+rw Nov 03 08:21:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-695d1f0b-753a-44eb-8a8d-9f53c89d0b63 tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:19 devstack sudo[95816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.info Nov 03 08:21:19 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:20 devstack sudo[95813]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:20 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a1ce622c-2271-4def-bda2-26951440c5ae tempest-VolumesSnapshotNegativeTestJSON-856996451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db" returned: 0 in 0.464s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a1ce622c-2271-4def-bda2-26951440c5ae tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db.eb530779-c1f2-468a-9342-50204f47d53f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-695d1f0b-753a-44eb-8a8d-9f53c89d0b63 tempest-SnapshotsActionsTest-14198360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.info" returned: 0 in 0.298s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:20 devstack sudo[95822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db.eb530779-c1f2-468a-9342-50204f47d53f Nov 03 08:21:20 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-695d1f0b-753a-44eb-8a8d-9f53c89d0b63 tempest-SnapshotsActionsTest-14198360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.297s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.927s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1305789974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4368a006-8689-4fef-8fc1-ebc003e55448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0dcedbd46474722ae2fec24dae5ef97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:21:18Z,use_quota=True,user_id='7268c9a78b504eea916c1fbe38889780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:21:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Creating volume 4368a006-8689-4fef-8fc1-ebc003e55448 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:21:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:21:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:21:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:21:20 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:21:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4368a006-8689-4fef-8fc1-ebc003e55448 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:20 devstack sudo[95824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4368a006-8689-4fef-8fc1-ebc003e55448 1073741824 Nov 03 08:21:20 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-695d1f0b-753a-44eb-8a8d-9f53c89d0b63 tempest-SnapshotsActionsTest-14198360 None] Create snapshot completed successfully Nov 03 08:21:20 devstack sudo[95824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:20 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a1ce622c-2271-4def-bda2-26951440c5ae tempest-VolumesSnapshotNegativeTestJSON-856996451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db.eb530779-c1f2-468a-9342-50204f47d53f" returned: 0 in 0.441s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a1ce622c-2271-4def-bda2-26951440c5ae tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db.eb530779-c1f2-468a-9342-50204f47d53f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:20 devstack sudo[95833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db.eb530779-c1f2-468a-9342-50204f47d53f Nov 03 08:21:20 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:20 devstack sudo[95824]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4368a006-8689-4fef-8fc1-ebc003e55448 1073741824" returned: 0 in 0.632s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4368a006-8689-4fef-8fc1-ebc003e55448 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:20 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4368a006-8689-4fef-8fc1-ebc003e55448 Nov 03 08:21:20 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:20 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a1ce622c-2271-4def-bda2-26951440c5ae tempest-VolumesSnapshotNegativeTestJSON-856996451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db.eb530779-c1f2-468a-9342-50204f47d53f" returned: 0 in 0.490s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:21 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a1ce622c-2271-4def-bda2-26951440c5ae tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Lock "cinder-quobyte-eb530779-c1f2-468a-9342-50204f47d53f" released by "_delete_snapshot" :: held 1.986s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:21 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a1ce622c-2271-4def-bda2-26951440c5ae tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Lock "cinder-quobyte-27be7d92-d2e1-49c2-b290-c224090891db" released by "delete_snapshot" :: held 2.018s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:21 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4368a006-8689-4fef-8fc1-ebc003e55448" returned: 0 in 0.302s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:21 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:21:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d566fea8-a0f6-408a-8f4a-19b0b54276d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4368a006-8689-4fef-8fc1-ebc003e55448', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4363dc5-531c-4faf-be72-f456b97a736f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:21 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Volume volume-4368a006-8689-4fef-8fc1-ebc003e55448 (4368a006-8689-4fef-8fc1-ebc003e55448): created successfully Nov 03 08:21:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4363dc5-531c-4faf-be72-f456b97a736f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Flow 'volume_create_manager' (6abefea5-95e5-4a1b-b5f1-e26b13659618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:21:21 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-fdee5cac-1581-4311-af22-3fd9fc8d10f5 tempest-VolumeQuotasAdminTestJSON-1314438054 None] Created volume successfully. Nov 03 08:21:21 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-a1ce622c-2271-4def-bda2-26951440c5ae tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Created reservations ['622506c4-dcc4-4093-818f-766dbdb38f4b', '60cff5cf-5cee-4fcf-8657-1e1a71312197', '75476216-1658-4601-b38d-9d722e03521a', '2168636d-1935-4542-b823-596af9948bd5'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:21:21 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-a1ce622c-2271-4def-bda2-26951440c5ae tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Delete snapshot completed successfully. Nov 03 08:21:21 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a1ce622c-2271-4def-bda2-26951440c5ae tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Lock "cinder-eb530779-c1f2-468a-9342-50204f47d53f-delete_snapshot" released by "delete_snapshot" :: held 2.270s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-89faa96d-ee3b-4221-85b7-22f46dd01503 tempest-SnapshotsActionsTest-14198360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-89faa96d-ee3b-4221-85b7-22f46dd01503 tempest-SnapshotsActionsTest-14198360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:21 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-89faa96d-ee3b-4221-85b7-22f46dd01503 tempest-SnapshotsActionsTest-14198360 None] Creating offline snapshot 409dc858-4bba-4977-b598-9293fb0b37b3 of volume 1b649550-d019-4ffa-bff6-338be3c86033 {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:21:21 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9204902-2624-4070-8150-8978d4338ad2]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-89faa96d-ee3b-4221-85b7-22f46dd01503 tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:21 devstack sudo[95840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb Nov 03 08:21:21 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:21 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-89faa96d-ee3b-4221-85b7-22f46dd01503 tempest-SnapshotsActionsTest-14198360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb" returned: 0 in 0.378s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:21 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-89faa96d-ee3b-4221-85b7-22f46dd01503 tempest-SnapshotsActionsTest-14198360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b649550-d019-4ffa-bff6-338be3c86033(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:21:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-89faa96d-ee3b-4221-85b7-22f46dd01503 tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.409dc858-4bba-4977-b598-9293fb0b37b3 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:21 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.409dc858-4bba-4977-b598-9293fb0b37b3 1G Nov 03 08:21:21 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:22 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-89faa96d-ee3b-4221-85b7-22f46dd01503 tempest-SnapshotsActionsTest-14198360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.409dc858-4bba-4977-b598-9293fb0b37b3 1G" returned: 0 in 0.479s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-89faa96d-ee3b-4221-85b7-22f46dd01503 tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.409dc858-4bba-4977-b598-9293fb0b37b3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:22 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.409dc858-4bba-4977-b598-9293fb0b37b3 Nov 03 08:21:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-36204ba8-3841-4763-a396-a010886e61b4 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Acquiring lock "cinder-27be7d92-d2e1-49c2-b290-c224090891db-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:22 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-36204ba8-3841-4763-a396-a010886e61b4 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Lock "cinder-27be7d92-d2e1-49c2-b290-c224090891db-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-36204ba8-3841-4763-a396-a010886e61b4 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Acquiring lock "cinder-quobyte-27be7d92-d2e1-49c2-b290-c224090891db" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-36204ba8-3841-4763-a396-a010886e61b4 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Lock "cinder-quobyte-27be7d92-d2e1-49c2-b290-c224090891db" acquired by "delete_volume" :: waited 0.015s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:22 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[f536263b-5bf7-4537-8d81-b6ee7728fa63]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-36204ba8-3841-4763-a396-a010886e61b4 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:22 devstack sudo[95853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db Nov 03 08:21:22 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:22 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-89faa96d-ee3b-4221-85b7-22f46dd01503 tempest-SnapshotsActionsTest-14198360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.409dc858-4bba-4977-b598-9293fb0b37b3" returned: 0 in 0.415s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:22 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-89faa96d-ee3b-4221-85b7-22f46dd01503 tempest-SnapshotsActionsTest-14198360 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.409dc858-4bba-4977-b598-9293fb0b37b3 is being set with open permissions: ugo+rw Nov 03 08:21:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-89faa96d-ee3b-4221-85b7-22f46dd01503 tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.409dc858-4bba-4977-b598-9293fb0b37b3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:22 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.409dc858-4bba-4977-b598-9293fb0b37b3 Nov 03 08:21:22 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:22 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-36204ba8-3841-4763-a396-a010886e61b4 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db" returned: 0 in 0.451s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-36204ba8-3841-4763-a396-a010886e61b4 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:22 devstack sudo[95865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db Nov 03 08:21:22 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:22 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-89faa96d-ee3b-4221-85b7-22f46dd01503 tempest-SnapshotsActionsTest-14198360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.409dc858-4bba-4977-b598-9293fb0b37b3" returned: 0 in 0.311s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-89faa96d-ee3b-4221-85b7-22f46dd01503 tempest-SnapshotsActionsTest-14198360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.708s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:23 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-89faa96d-ee3b-4221-85b7-22f46dd01503 tempest-SnapshotsActionsTest-14198360 None] Create snapshot completed successfully Nov 03 08:21:23 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:23 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-35497679-3421-41bc-bfa8-81d5c081a2dd tempest-VolumeQuotasAdminTestJSON-1513026663 None] Transfer volume completed successfully. Nov 03 08:21:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-36204ba8-3841-4763-a396-a010886e61b4 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27be7d92-d2e1-49c2-b290-c224090891db" returned: 0 in 0.319s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:23 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-36204ba8-3841-4763-a396-a010886e61b4 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Lock "cinder-quobyte-27be7d92-d2e1-49c2-b290-c224090891db" released by "delete_volume" :: held 0.858s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:23 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-36204ba8-3841-4763-a396-a010886e61b4 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Created reservations ['3648196b-554a-493e-8978-230c4f15a503', 'ab519287-96e2-4cb0-b7e1-df819e49ca6f', '2cf01bbb-9c70-4d0f-b7ab-e9b925b1d044', '88bfffec-95e5-4ee2-8d8b-9d241303a808'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:21:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-36204ba8-3841-4763-a396-a010886e61b4 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-36204ba8-3841-4763-a396-a010886e61b4 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-36204ba8-3841-4763-a396-a010886e61b4 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:21:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-36204ba8-3841-4763-a396-a010886e61b4 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:21:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-36204ba8-3841-4763-a396-a010886e61b4 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-36204ba8-3841-4763-a396-a010886e61b4 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:23 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:21:23 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:23 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-bf2e1e93-32c2-4e5a-bd37-2f6f6327c379 tempest-SnapshotsActionsTest-433722804 None] Acquiring lock "cinder-409dc858-4bba-4977-b598-9293fb0b37b3-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:23 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-bf2e1e93-32c2-4e5a-bd37-2f6f6327c379 tempest-SnapshotsActionsTest-433722804 None] Lock "cinder-409dc858-4bba-4977-b598-9293fb0b37b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:23 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-bf2e1e93-32c2-4e5a-bd37-2f6f6327c379 tempest-SnapshotsActionsTest-433722804 None] Acquiring lock "cinder-quobyte-1b649550-d019-4ffa-bff6-338be3c86033" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:23 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-bf2e1e93-32c2-4e5a-bd37-2f6f6327c379 tempest-SnapshotsActionsTest-433722804 None] Lock "cinder-quobyte-1b649550-d019-4ffa-bff6-338be3c86033" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:23 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-bf2e1e93-32c2-4e5a-bd37-2f6f6327c379 tempest-SnapshotsActionsTest-433722804 None] Acquiring lock "cinder-quobyte-409dc858-4bba-4977-b598-9293fb0b37b3" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:23 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-bf2e1e93-32c2-4e5a-bd37-2f6f6327c379 tempest-SnapshotsActionsTest-433722804 None] Lock "cinder-quobyte-409dc858-4bba-4977-b598-9293fb0b37b3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-bf2e1e93-32c2-4e5a-bd37-2f6f6327c379 tempest-SnapshotsActionsTest-433722804 None] Deleting offline snapshot 409dc858-4bba-4977-b598-9293fb0b37b3 of volume 1b649550-d019-4ffa-bff6-338be3c86033 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:21:23 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-bf2e1e93-32c2-4e5a-bd37-2f6f6327c379 tempest-SnapshotsActionsTest-433722804 None] snapshot_file for this snap is: volume-1b649550-d019-4ffa-bff6-338be3c86033.409dc858-4bba-4977-b598-9293fb0b37b3 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:21:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-36204ba8-3841-4763-a396-a010886e61b4 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.418s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:23 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-36204ba8-3841-4763-a396-a010886e61b4 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:21:23 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-36204ba8-3841-4763-a396-a010886e61b4 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Deleted volume successfully. Nov 03 08:21:23 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eeef32a-74dc-43d6-9cb3-cbe69907001c]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bf2e1e93-32c2-4e5a-bd37-2f6f6327c379 tempest-SnapshotsActionsTest-433722804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.409dc858-4bba-4977-b598-9293fb0b37b3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:23 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-36204ba8-3841-4763-a396-a010886e61b4 tempest-VolumesSnapshotNegativeTestJSON-856996451 None] Lock "cinder-27be7d92-d2e1-49c2-b290-c224090891db-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:23 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f9c74a4a-903e-4fa4-bab5-8e2709b4dc13 tempest-VolumeQuotasAdminTestJSON-1331666085 None] Acquiring lock "cinder-4368a006-8689-4fef-8fc1-ebc003e55448-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:23 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f9c74a4a-903e-4fa4-bab5-8e2709b4dc13 tempest-VolumeQuotasAdminTestJSON-1331666085 None] Lock "cinder-4368a006-8689-4fef-8fc1-ebc003e55448-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:24 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f9c74a4a-903e-4fa4-bab5-8e2709b4dc13 tempest-VolumeQuotasAdminTestJSON-1331666085 None] Acquiring lock "cinder-quobyte-4368a006-8689-4fef-8fc1-ebc003e55448" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:24 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f9c74a4a-903e-4fa4-bab5-8e2709b4dc13 tempest-VolumeQuotasAdminTestJSON-1331666085 None] Lock "cinder-quobyte-4368a006-8689-4fef-8fc1-ebc003e55448" acquired by "delete_volume" :: waited 0.028s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:24 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[476a6f50-5e47-48c1-8b3c-1f2f1e62b718]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f9c74a4a-903e-4fa4-bab5-8e2709b4dc13 tempest-VolumeQuotasAdminTestJSON-1331666085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4368a006-8689-4fef-8fc1-ebc003e55448 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:24 devstack sudo[95872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.409dc858-4bba-4977-b598-9293fb0b37b3 Nov 03 08:21:24 devstack sudo[95872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:24 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4368a006-8689-4fef-8fc1-ebc003e55448 Nov 03 08:21:24 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:24 devstack sudo[95872]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bf2e1e93-32c2-4e5a-bd37-2f6f6327c379 tempest-SnapshotsActionsTest-433722804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.409dc858-4bba-4977-b598-9293fb0b37b3" returned: 0 in 0.509s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-bf2e1e93-32c2-4e5a-bd37-2f6f6327c379 tempest-SnapshotsActionsTest-433722804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b649550-d019-4ffa-bff6-338be3c86033(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:21:24 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[624dc9ac-5441-4218-9209-9233e34a2fb0]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bf2e1e93-32c2-4e5a-bd37-2f6f6327c379 tempest-SnapshotsActionsTest-433722804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:24 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f9c74a4a-903e-4fa4-bab5-8e2709b4dc13 tempest-VolumeQuotasAdminTestJSON-1331666085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4368a006-8689-4fef-8fc1-ebc003e55448" returned: 0 in 0.452s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f9c74a4a-903e-4fa4-bab5-8e2709b4dc13 tempest-VolumeQuotasAdminTestJSON-1331666085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4368a006-8689-4fef-8fc1-ebc003e55448 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:24 devstack sudo[95883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb Nov 03 08:21:24 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:24 devstack sudo[95885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4368a006-8689-4fef-8fc1-ebc003e55448 Nov 03 08:21:24 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:24 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f9c74a4a-903e-4fa4-bab5-8e2709b4dc13 tempest-VolumeQuotasAdminTestJSON-1331666085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4368a006-8689-4fef-8fc1-ebc003e55448" returned: 0 in 0.364s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:24 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bf2e1e93-32c2-4e5a-bd37-2f6f6327c379 tempest-SnapshotsActionsTest-433722804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb" returned: 0 in 0.457s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-bf2e1e93-32c2-4e5a-bd37-2f6f6327c379 tempest-SnapshotsActionsTest-433722804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b649550-d019-4ffa-bff6-338be3c86033(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:21:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bf2e1e93-32c2-4e5a-bd37-2f6f6327c379 tempest-SnapshotsActionsTest-433722804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.409dc858-4bba-4977-b598-9293fb0b37b3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:24 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f9c74a4a-903e-4fa4-bab5-8e2709b4dc13 tempest-VolumeQuotasAdminTestJSON-1331666085 None] Lock "cinder-quobyte-4368a006-8689-4fef-8fc1-ebc003e55448" released by "delete_volume" :: held 0.885s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:24 devstack sudo[95892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.409dc858-4bba-4977-b598-9293fb0b37b3 Nov 03 08:21:24 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:24 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-f9c74a4a-903e-4fa4-bab5-8e2709b4dc13 tempest-VolumeQuotasAdminTestJSON-1331666085 None] Created reservations ['b5b7af20-35a4-40e7-a216-b8da9497f7b2', '58077c1d-7827-415c-9452-a9cb02764351', '95cc3e43-d13f-45f5-ab99-dfbfaf3e9c86', '77de7cc1-ece9-47d3-a092-6590e5801fa6'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:21:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f9c74a4a-903e-4fa4-bab5-8e2709b4dc13 tempest-VolumeQuotasAdminTestJSON-1331666085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f9c74a4a-903e-4fa4-bab5-8e2709b4dc13 tempest-VolumeQuotasAdminTestJSON-1331666085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f9c74a4a-903e-4fa4-bab5-8e2709b4dc13 tempest-VolumeQuotasAdminTestJSON-1331666085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:21:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f9c74a4a-903e-4fa4-bab5-8e2709b4dc13 tempest-VolumeQuotasAdminTestJSON-1331666085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:21:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f9c74a4a-903e-4fa4-bab5-8e2709b4dc13 tempest-VolumeQuotasAdminTestJSON-1331666085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f9c74a4a-903e-4fa4-bab5-8e2709b4dc13 tempest-VolumeQuotasAdminTestJSON-1331666085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:25 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:21:25 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:25 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f9c74a4a-903e-4fa4-bab5-8e2709b4dc13 tempest-VolumeQuotasAdminTestJSON-1331666085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.435s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:25 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-f9c74a4a-903e-4fa4-bab5-8e2709b4dc13 tempest-VolumeQuotasAdminTestJSON-1331666085 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:21:25 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-f9c74a4a-903e-4fa4-bab5-8e2709b4dc13 tempest-VolumeQuotasAdminTestJSON-1331666085 None] Deleted volume successfully. Nov 03 08:21:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f9c74a4a-903e-4fa4-bab5-8e2709b4dc13 tempest-VolumeQuotasAdminTestJSON-1331666085 None] Lock "cinder-4368a006-8689-4fef-8fc1-ebc003e55448-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:25 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bf2e1e93-32c2-4e5a-bd37-2f6f6327c379 tempest-SnapshotsActionsTest-433722804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.409dc858-4bba-4977-b598-9293fb0b37b3" returned: 0 in 0.715s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bf2e1e93-32c2-4e5a-bd37-2f6f6327c379 tempest-SnapshotsActionsTest-433722804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.409dc858-4bba-4977-b598-9293fb0b37b3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:25 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.409dc858-4bba-4977-b598-9293fb0b37b3 Nov 03 08:21:25 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:25 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bf2e1e93-32c2-4e5a-bd37-2f6f6327c379 tempest-SnapshotsActionsTest-433722804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.409dc858-4bba-4977-b598-9293fb0b37b3" returned: 0 in 0.334s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-bf2e1e93-32c2-4e5a-bd37-2f6f6327c379 tempest-SnapshotsActionsTest-433722804 None] Lock "cinder-quobyte-409dc858-4bba-4977-b598-9293fb0b37b3" released by "_delete_snapshot" :: held 2.187s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:26 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-bf2e1e93-32c2-4e5a-bd37-2f6f6327c379 tempest-SnapshotsActionsTest-433722804 None] Lock "cinder-quobyte-1b649550-d019-4ffa-bff6-338be3c86033" released by "delete_snapshot" :: held 2.227s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:26 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-bf2e1e93-32c2-4e5a-bd37-2f6f6327c379 tempest-SnapshotsActionsTest-433722804 None] Created reservations ['4f08597c-eefd-473f-872a-7a93b475ae9d', '9dfe16d0-51e2-472d-bba9-29df08f96f4a', '201c6ea5-c04f-4b2f-95e3-bd2e2b662706', '2a2a32a8-5cd7-47d6-b521-655aeeb47ac0'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:21:26 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-bf2e1e93-32c2-4e5a-bd37-2f6f6327c379 tempest-SnapshotsActionsTest-433722804 None] Delete snapshot completed successfully. Nov 03 08:21:26 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-bf2e1e93-32c2-4e5a-bd37-2f6f6327c379 tempest-SnapshotsActionsTest-433722804 None] Lock "cinder-409dc858-4bba-4977-b598-9293fb0b37b3-delete_snapshot" released by "delete_snapshot" :: held 2.406s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b1755d92-225d-400e-b2a9-7adb1edd69ae tempest-SnapshotsActionsTest-14198360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b1755d92-225d-400e-b2a9-7adb1edd69ae tempest-SnapshotsActionsTest-14198360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-b1755d92-225d-400e-b2a9-7adb1edd69ae tempest-SnapshotsActionsTest-14198360 None] Creating offline snapshot 1085e980-163b-40fe-94d7-5e6d25727951 of volume 1b649550-d019-4ffa-bff6-338be3c86033 {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:21:27 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[d542244e-18db-4fa6-8021-62c8f1bb1379]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b1755d92-225d-400e-b2a9-7adb1edd69ae tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:27 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb Nov 03 08:21:27 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:27 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b1755d92-225d-400e-b2a9-7adb1edd69ae tempest-SnapshotsActionsTest-14198360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb" returned: 0 in 0.424s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-b1755d92-225d-400e-b2a9-7adb1edd69ae tempest-SnapshotsActionsTest-14198360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b649550-d019-4ffa-bff6-338be3c86033(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:21:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b1755d92-225d-400e-b2a9-7adb1edd69ae tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.1085e980-163b-40fe-94d7-5e6d25727951 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:27 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.1085e980-163b-40fe-94d7-5e6d25727951 1G Nov 03 08:21:27 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:28 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b1755d92-225d-400e-b2a9-7adb1edd69ae tempest-SnapshotsActionsTest-14198360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.1085e980-163b-40fe-94d7-5e6d25727951 1G" returned: 0 in 0.643s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b1755d92-225d-400e-b2a9-7adb1edd69ae tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.1085e980-163b-40fe-94d7-5e6d25727951 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:28 devstack sudo[95919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.1085e980-163b-40fe-94d7-5e6d25727951 Nov 03 08:21:28 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:29 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b1755d92-225d-400e-b2a9-7adb1edd69ae tempest-SnapshotsActionsTest-14198360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.1085e980-163b-40fe-94d7-5e6d25727951" returned: 0 in 0.510s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:29 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-b1755d92-225d-400e-b2a9-7adb1edd69ae tempest-SnapshotsActionsTest-14198360 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.1085e980-163b-40fe-94d7-5e6d25727951 is being set with open permissions: ugo+rw Nov 03 08:21:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b1755d92-225d-400e-b2a9-7adb1edd69ae tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.1085e980-163b-40fe-94d7-5e6d25727951 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:29 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.1085e980-163b-40fe-94d7-5e6d25727951 Nov 03 08:21:29 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:29 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b1755d92-225d-400e-b2a9-7adb1edd69ae tempest-SnapshotsActionsTest-14198360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.1085e980-163b-40fe-94d7-5e6d25727951" returned: 0 in 0.286s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b1755d92-225d-400e-b2a9-7adb1edd69ae tempest-SnapshotsActionsTest-14198360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:29 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-b1755d92-225d-400e-b2a9-7adb1edd69ae tempest-SnapshotsActionsTest-14198360 None] Create snapshot completed successfully Nov 03 08:21:30 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-fffd7613-7bbc-472e-b118-71d4a20aeb66 tempest-SnapshotsActionsTest-433722804 None] Acquiring lock "cinder-1085e980-163b-40fe-94d7-5e6d25727951-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:30 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-fffd7613-7bbc-472e-b118-71d4a20aeb66 tempest-SnapshotsActionsTest-433722804 None] Lock "cinder-1085e980-163b-40fe-94d7-5e6d25727951-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:30 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-fffd7613-7bbc-472e-b118-71d4a20aeb66 tempest-SnapshotsActionsTest-433722804 None] Acquiring lock "cinder-quobyte-1b649550-d019-4ffa-bff6-338be3c86033" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:30 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-fffd7613-7bbc-472e-b118-71d4a20aeb66 tempest-SnapshotsActionsTest-433722804 None] Lock "cinder-quobyte-1b649550-d019-4ffa-bff6-338be3c86033" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:30 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-fffd7613-7bbc-472e-b118-71d4a20aeb66 tempest-SnapshotsActionsTest-433722804 None] Acquiring lock "cinder-quobyte-1085e980-163b-40fe-94d7-5e6d25727951" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:30 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-fffd7613-7bbc-472e-b118-71d4a20aeb66 tempest-SnapshotsActionsTest-433722804 None] Lock "cinder-quobyte-1085e980-163b-40fe-94d7-5e6d25727951" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-fffd7613-7bbc-472e-b118-71d4a20aeb66 tempest-SnapshotsActionsTest-433722804 None] Deleting offline snapshot 1085e980-163b-40fe-94d7-5e6d25727951 of volume 1b649550-d019-4ffa-bff6-338be3c86033 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:21:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-fffd7613-7bbc-472e-b118-71d4a20aeb66 tempest-SnapshotsActionsTest-433722804 None] snapshot_file for this snap is: volume-1b649550-d019-4ffa-bff6-338be3c86033.1085e980-163b-40fe-94d7-5e6d25727951 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:21:30 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efaccda-e0e7-4f3a-aa50-f3e53e509681]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fffd7613-7bbc-472e-b118-71d4a20aeb66 tempest-SnapshotsActionsTest-433722804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.1085e980-163b-40fe-94d7-5e6d25727951 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:31 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.1085e980-163b-40fe-94d7-5e6d25727951 Nov 03 08:21:31 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:31 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fffd7613-7bbc-472e-b118-71d4a20aeb66 tempest-SnapshotsActionsTest-433722804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.1085e980-163b-40fe-94d7-5e6d25727951" returned: 0 in 0.555s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-fffd7613-7bbc-472e-b118-71d4a20aeb66 tempest-SnapshotsActionsTest-433722804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b649550-d019-4ffa-bff6-338be3c86033(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:21:31 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[12042fb0-506d-4452-9520-03934727279a]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fffd7613-7bbc-472e-b118-71d4a20aeb66 tempest-SnapshotsActionsTest-433722804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:31 devstack sudo[95932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb Nov 03 08:21:31 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:31 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fffd7613-7bbc-472e-b118-71d4a20aeb66 tempest-SnapshotsActionsTest-433722804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb" returned: 0 in 0.480s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-fffd7613-7bbc-472e-b118-71d4a20aeb66 tempest-SnapshotsActionsTest-433722804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b649550-d019-4ffa-bff6-338be3c86033(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:21:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fffd7613-7bbc-472e-b118-71d4a20aeb66 tempest-SnapshotsActionsTest-433722804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.1085e980-163b-40fe-94d7-5e6d25727951 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:31 devstack sudo[95939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.1085e980-163b-40fe-94d7-5e6d25727951 Nov 03 08:21:31 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:32 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fffd7613-7bbc-472e-b118-71d4a20aeb66 tempest-SnapshotsActionsTest-433722804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.1085e980-163b-40fe-94d7-5e6d25727951" returned: 0 in 0.482s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fffd7613-7bbc-472e-b118-71d4a20aeb66 tempest-SnapshotsActionsTest-433722804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.1085e980-163b-40fe-94d7-5e6d25727951 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:32 devstack sudo[95946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.1085e980-163b-40fe-94d7-5e6d25727951 Nov 03 08:21:32 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:32 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fffd7613-7bbc-472e-b118-71d4a20aeb66 tempest-SnapshotsActionsTest-433722804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.1085e980-163b-40fe-94d7-5e6d25727951" returned: 0 in 0.338s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:32 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-fffd7613-7bbc-472e-b118-71d4a20aeb66 tempest-SnapshotsActionsTest-433722804 None] Lock "cinder-quobyte-1085e980-163b-40fe-94d7-5e6d25727951" released by "_delete_snapshot" :: held 2.023s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:32 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-fffd7613-7bbc-472e-b118-71d4a20aeb66 tempest-SnapshotsActionsTest-433722804 None] Lock "cinder-quobyte-1b649550-d019-4ffa-bff6-338be3c86033" released by "delete_snapshot" :: held 2.060s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:32 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-fffd7613-7bbc-472e-b118-71d4a20aeb66 tempest-SnapshotsActionsTest-433722804 None] Created reservations ['ef562074-03ca-4d19-b7f0-6784f4b7a22c', '119b6233-a4f4-4707-b3a8-a334d40f5cf7', '518d15b0-7de2-4dc9-bc15-d6cc75c67cc7', 'f1981ce7-0f4e-499d-9fe7-ba714432bedd'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:21:33 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-fffd7613-7bbc-472e-b118-71d4a20aeb66 tempest-SnapshotsActionsTest-433722804 None] Delete snapshot completed successfully. Nov 03 08:21:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-fffd7613-7bbc-472e-b118-71d4a20aeb66 tempest-SnapshotsActionsTest-433722804 None] Lock "cinder-1085e980-163b-40fe-94d7-5e6d25727951-delete_snapshot" released by "delete_snapshot" :: held 2.317s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-77961840-6cb9-4006-bb6b-f79eed13db70 tempest-SnapshotsActionsTest-14198360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-77961840-6cb9-4006-bb6b-f79eed13db70 tempest-SnapshotsActionsTest-14198360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:34 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-77961840-6cb9-4006-bb6b-f79eed13db70 tempest-SnapshotsActionsTest-14198360 None] Creating offline snapshot a5da4259-6db3-4f55-904d-ba6a62a96ea5 of volume 1b649550-d019-4ffa-bff6-338be3c86033 {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:21:34 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc639f55-f9e4-43ad-b14a-a555d0f92484]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-77961840-6cb9-4006-bb6b-f79eed13db70 tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:34 devstack sudo[95949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb Nov 03 08:21:34 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:35 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-77961840-6cb9-4006-bb6b-f79eed13db70 tempest-SnapshotsActionsTest-14198360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb" returned: 0 in 0.564s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-77961840-6cb9-4006-bb6b-f79eed13db70 tempest-SnapshotsActionsTest-14198360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b649550-d019-4ffa-bff6-338be3c86033(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:21:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-77961840-6cb9-4006-bb6b-f79eed13db70 tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.a5da4259-6db3-4f55-904d-ba6a62a96ea5 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:35 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.a5da4259-6db3-4f55-904d-ba6a62a96ea5 1G Nov 03 08:21:35 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:35 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-77961840-6cb9-4006-bb6b-f79eed13db70 tempest-SnapshotsActionsTest-14198360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.a5da4259-6db3-4f55-904d-ba6a62a96ea5 1G" returned: 0 in 0.725s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-77961840-6cb9-4006-bb6b-f79eed13db70 tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.a5da4259-6db3-4f55-904d-ba6a62a96ea5 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:35 devstack sudo[95960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.a5da4259-6db3-4f55-904d-ba6a62a96ea5 Nov 03 08:21:35 devstack sudo[95960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:36 devstack sudo[95960]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-77961840-6cb9-4006-bb6b-f79eed13db70 tempest-SnapshotsActionsTest-14198360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.a5da4259-6db3-4f55-904d-ba6a62a96ea5" returned: 0 in 0.475s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:36 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-77961840-6cb9-4006-bb6b-f79eed13db70 tempest-SnapshotsActionsTest-14198360 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.a5da4259-6db3-4f55-904d-ba6a62a96ea5 is being set with open permissions: ugo+rw Nov 03 08:21:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-77961840-6cb9-4006-bb6b-f79eed13db70 tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.a5da4259-6db3-4f55-904d-ba6a62a96ea5 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:36 devstack sudo[95966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.a5da4259-6db3-4f55-904d-ba6a62a96ea5 Nov 03 08:21:36 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:36 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-77961840-6cb9-4006-bb6b-f79eed13db70 tempest-SnapshotsActionsTest-14198360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.a5da4259-6db3-4f55-904d-ba6a62a96ea5" returned: 0 in 0.402s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-77961840-6cb9-4006-bb6b-f79eed13db70 tempest-SnapshotsActionsTest-14198360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.324s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:36 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-77961840-6cb9-4006-bb6b-f79eed13db70 tempest-SnapshotsActionsTest-14198360 None] Create snapshot completed successfully Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Flow 'volume_create_manager' (c3a3f1c7-4eff-43fa-8f47-249f04a9f2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e4c5c76-0ca3-4ef1-86c0-280cc60a846c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e4c5c76-0ca3-4ef1-86c0-280cc60a846c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1315976387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0b999ed-d058-44a8-88eb-90bba852b7d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0f3bdfd08148ff872a1c8453820e0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:21:37Z,use_quota=True,user_id='3befd85f0e404e55ab3d76fb38f454c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d4ac1a-78d7-4a33-965e-ec2d2c6a41ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d4ac1a-78d7-4a33-965e-ec2d2c6a41ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50cd5553-6a1d-47de-97c5-02167e99d49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50cd5553-6a1d-47de-97c5-02167e99d49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0b999ed-d058-44a8-88eb-90bba852b7d1', 'volume_name': 'volume-f0b999ed-d058-44a8-88eb-90bba852b7d1', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd98fe9-09dc-40c4-9956-f997f3fb56c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd98fe9-09dc-40c4-9956-f997f3fb56c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc2f8f6d-57d9-44fa-951e-15b338966188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:37 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Volume f0b999ed-d058-44a8-88eb-90bba852b7d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0b999ed-d058-44a8-88eb-90bba852b7d1', 'volume_size': 1} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1315976387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0b999ed-d058-44a8-88eb-90bba852b7d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0f3bdfd08148ff872a1c8453820e0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:21:37Z,use_quota=True,user_id='3befd85f0e404e55ab3d76fb38f454c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Creating volume f0b999ed-d058-44a8-88eb-90bba852b7d1 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:21:37 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0b999ed-d058-44a8-88eb-90bba852b7d1 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:37 devstack sudo[95969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0b999ed-d058-44a8-88eb-90bba852b7d1 1073741824 Nov 03 08:21:37 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-24a31ba5-6eb0-47df-96c2-14796ed104a1 tempest-SnapshotsActionsTest-433722804 None] Acquiring lock "cinder-a5da4259-6db3-4f55-904d-ba6a62a96ea5-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-24a31ba5-6eb0-47df-96c2-14796ed104a1 tempest-SnapshotsActionsTest-433722804 None] Lock "cinder-a5da4259-6db3-4f55-904d-ba6a62a96ea5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-24a31ba5-6eb0-47df-96c2-14796ed104a1 tempest-SnapshotsActionsTest-433722804 None] Acquiring lock "cinder-quobyte-1b649550-d019-4ffa-bff6-338be3c86033" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-24a31ba5-6eb0-47df-96c2-14796ed104a1 tempest-SnapshotsActionsTest-433722804 None] Lock "cinder-quobyte-1b649550-d019-4ffa-bff6-338be3c86033" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-24a31ba5-6eb0-47df-96c2-14796ed104a1 tempest-SnapshotsActionsTest-433722804 None] Acquiring lock "cinder-quobyte-a5da4259-6db3-4f55-904d-ba6a62a96ea5" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-24a31ba5-6eb0-47df-96c2-14796ed104a1 tempest-SnapshotsActionsTest-433722804 None] Lock "cinder-quobyte-a5da4259-6db3-4f55-904d-ba6a62a96ea5" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-24a31ba5-6eb0-47df-96c2-14796ed104a1 tempest-SnapshotsActionsTest-433722804 None] Deleting offline snapshot a5da4259-6db3-4f55-904d-ba6a62a96ea5 of volume 1b649550-d019-4ffa-bff6-338be3c86033 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-24a31ba5-6eb0-47df-96c2-14796ed104a1 tempest-SnapshotsActionsTest-433722804 None] snapshot_file for this snap is: volume-1b649550-d019-4ffa-bff6-338be3c86033.a5da4259-6db3-4f55-904d-ba6a62a96ea5 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7350412-5c7c-4f37-9384-77cb6a88fa11]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-24a31ba5-6eb0-47df-96c2-14796ed104a1 tempest-SnapshotsActionsTest-433722804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.a5da4259-6db3-4f55-904d-ba6a62a96ea5 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:38 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.a5da4259-6db3-4f55-904d-ba6a62a96ea5 Nov 03 08:21:38 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:38 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0b999ed-d058-44a8-88eb-90bba852b7d1 1073741824" returned: 0 in 0.654s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0b999ed-d058-44a8-88eb-90bba852b7d1 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:38 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0b999ed-d058-44a8-88eb-90bba852b7d1 Nov 03 08:21:38 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:38 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-24a31ba5-6eb0-47df-96c2-14796ed104a1 tempest-SnapshotsActionsTest-433722804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.a5da4259-6db3-4f55-904d-ba6a62a96ea5" returned: 0 in 0.600s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-24a31ba5-6eb0-47df-96c2-14796ed104a1 tempest-SnapshotsActionsTest-433722804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b649550-d019-4ffa-bff6-338be3c86033(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:21:38 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb07712-411e-4109-8b9f-27902fd8701a]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-24a31ba5-6eb0-47df-96c2-14796ed104a1 tempest-SnapshotsActionsTest-433722804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:38 devstack sudo[95982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb Nov 03 08:21:38 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:38 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0b999ed-d058-44a8-88eb-90bba852b7d1" returned: 0 in 0.345s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:21:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc2f8f6d-57d9-44fa-951e-15b338966188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0b999ed-d058-44a8-88eb-90bba852b7d1', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a5e2d2-fcf5-4589-a93c-32db37d479dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:38 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Volume volume-f0b999ed-d058-44a8-88eb-90bba852b7d1 (f0b999ed-d058-44a8-88eb-90bba852b7d1): created successfully Nov 03 08:21:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a5e2d2-fcf5-4589-a93c-32db37d479dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Flow 'volume_create_manager' (c3a3f1c7-4eff-43fa-8f47-249f04a9f2c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:21:38 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-907c3c9d-6ba3-4b45-b526-b4222a3e96cf tempest-VolumesServicesTestJSON-1234699856 None] Created volume successfully. Nov 03 08:21:38 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:21:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Flow 'volume_create_manager' (acaa7f42-8573-4267-97ac-4349150bf094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:21:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9807f528-3368-4a02-a65e-f6cf15501f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9807f528-3368-4a02-a65e-f6cf15501f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1974030081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c3315e-bb40-4101-a420-83d96295a953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='818c120b75514b93b307f6d125eb8a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:21:39Z,use_quota=True,user_id='fece67ec285544428d9402417a2bfc2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125c562e-0e46-4ea9-8e73-8f80683652ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125c562e-0e46-4ea9-8e73-8f80683652ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1384ea6b-ae66-4815-a5f8-f253e1ddc3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:39 devstack cinder-volume[86801]: DEBUG cinder.image.glance [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Creating Keystone auth plugin from conf {{(pid=86801) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 08:21:39 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-24a31ba5-6eb0-47df-96c2-14796ed104a1 tempest-SnapshotsActionsTest-433722804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb" returned: 0 in 0.514s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:39 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-24a31ba5-6eb0-47df-96c2-14796ed104a1 tempest-SnapshotsActionsTest-433722804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b649550-d019-4ffa-bff6-338be3c86033(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:21:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-24a31ba5-6eb0-47df-96c2-14796ed104a1 tempest-SnapshotsActionsTest-433722804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.a5da4259-6db3-4f55-904d-ba6a62a96ea5 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:39 devstack sudo[95988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.a5da4259-6db3-4f55-904d-ba6a62a96ea5 Nov 03 08:21:39 devstack sudo[95988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1384ea6b-ae66-4815-a5f8-f253e1ddc3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f7c3315e-bb40-4101-a420-83d96295a953', 'volume_name': 'volume-f7c3315e-bb40-4101-a420-83d96295a953', 'volume_size': 1, 'image_id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02c779626a284994918db1738b55fe79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'created_at': datetime.datetime(2026, 11, 3, 7, 8, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 8, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9eb5e936-be4c-46be-8de8-899e9fc38d33/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a65350b-a62f-4be4-ab89-b9c8e55a154b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a65350b-a62f-4be4-ab89-b9c8e55a154b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ddc0c96-d498-4f34-b5ec-5918aa9cc70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:39 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Volume f7c3315e-bb40-4101-a420-83d96295a953: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f7c3315e-bb40-4101-a420-83d96295a953', 'volume_size': 1, 'image_id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02c779626a284994918db1738b55fe79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'created_at': datetime.datetime(2026, 11, 3, 7, 8, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 8, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9eb5e936-be4c-46be-8de8-899e9fc38d33/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 08:21:39 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Trying to clone f7c3315e-bb40-4101-a420-83d96295a953 from image 9eb5e936-be4c-46be-8de8-899e9fc38d33 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}]). {{(pid=86801) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 08:21:39 devstack sudo[95988]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-24a31ba5-6eb0-47df-96c2-14796ed104a1 tempest-SnapshotsActionsTest-433722804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.a5da4259-6db3-4f55-904d-ba6a62a96ea5" returned: 0 in 0.525s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-24a31ba5-6eb0-47df-96c2-14796ed104a1 tempest-SnapshotsActionsTest-433722804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.a5da4259-6db3-4f55-904d-ba6a62a96ea5 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:39 devstack sudo[95994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.a5da4259-6db3-4f55-904d-ba6a62a96ea5 Nov 03 08:21:39 devstack sudo[95994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:39 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33__dnkxds9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 08:21:39 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Image download 20.69 MB at 20.69 MB/s Nov 03 08:21:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-abd62112-4863-480c-ad44-dd2f9a580744 tempest-VolumesServicesTestJSON-1234699856 None] Acquiring lock "cinder-f0b999ed-d058-44a8-88eb-90bba852b7d1-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:39 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd1d0a9-6e93-46c9-8abf-e6080dc38005]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33__dnkxds9devstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-abd62112-4863-480c-ad44-dd2f9a580744 tempest-VolumesServicesTestJSON-1234699856 None] Lock "cinder-f0b999ed-d058-44a8-88eb-90bba852b7d1-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-abd62112-4863-480c-ad44-dd2f9a580744 tempest-VolumesServicesTestJSON-1234699856 None] Acquiring lock "cinder-quobyte-f0b999ed-d058-44a8-88eb-90bba852b7d1" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:40 devstack sudo[95994]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-abd62112-4863-480c-ad44-dd2f9a580744 tempest-VolumesServicesTestJSON-1234699856 None] Lock "cinder-quobyte-f0b999ed-d058-44a8-88eb-90bba852b7d1" acquired by "delete_volume" :: waited 0.016s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-24a31ba5-6eb0-47df-96c2-14796ed104a1 tempest-SnapshotsActionsTest-433722804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.a5da4259-6db3-4f55-904d-ba6a62a96ea5" returned: 0 in 0.541s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:40 devstack sudo[95997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33__dnkxds9devstack@QuobyteHD Nov 03 08:21:40 devstack sudo[95997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc03f3c2-b29d-4785-8ca4-b5ea4b7d030c]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-abd62112-4863-480c-ad44-dd2f9a580744 tempest-VolumesServicesTestJSON-1234699856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0b999ed-d058-44a8-88eb-90bba852b7d1 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-24a31ba5-6eb0-47df-96c2-14796ed104a1 tempest-SnapshotsActionsTest-433722804 None] Lock "cinder-quobyte-a5da4259-6db3-4f55-904d-ba6a62a96ea5" released by "_delete_snapshot" :: held 2.335s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-24a31ba5-6eb0-47df-96c2-14796ed104a1 tempest-SnapshotsActionsTest-433722804 None] Lock "cinder-quobyte-1b649550-d019-4ffa-bff6-338be3c86033" released by "delete_snapshot" :: held 2.391s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:40 devstack sudo[96000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0b999ed-d058-44a8-88eb-90bba852b7d1 Nov 03 08:21:40 devstack sudo[96000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-24a31ba5-6eb0-47df-96c2-14796ed104a1 tempest-SnapshotsActionsTest-433722804 None] Created reservations ['d537b3f5-e936-42b1-80ab-63d27d814f17', 'ae5cfd75-4d8d-4d05-b4bb-0b546b2b3fc7', 'e55c7998-7846-412f-b1b7-8cc67e93681c', 'd961895f-a341-4f77-aff4-6284662be288'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:21:40 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-24a31ba5-6eb0-47df-96c2-14796ed104a1 tempest-SnapshotsActionsTest-433722804 None] Delete snapshot completed successfully. Nov 03 08:21:40 devstack sudo[95997]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33__dnkxds9devstack@QuobyteHD" returned: 0 in 0.442s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Temporary image 9eb5e936-be4c-46be-8de8-899e9fc38d33 is fetched for user fece67ec285544428d9402417a2bfc2a. {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-24a31ba5-6eb0-47df-96c2-14796ed104a1 tempest-SnapshotsActionsTest-433722804 None] Lock "cinder-a5da4259-6db3-4f55-904d-ba6a62a96ea5-delete_snapshot" released by "delete_snapshot" :: held 2.637s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f824fdb-8003-4dc6-9cd7-94d98bc5a950]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33__dnkxds9devstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:40 devstack sudo[96000]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-abd62112-4863-480c-ad44-dd2f9a580744 tempest-VolumesServicesTestJSON-1234699856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0b999ed-d058-44a8-88eb-90bba852b7d1" returned: 0 in 0.431s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-abd62112-4863-480c-ad44-dd2f9a580744 tempest-VolumesServicesTestJSON-1234699856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0b999ed-d058-44a8-88eb-90bba852b7d1 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:40 devstack sudo[96010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0b999ed-d058-44a8-88eb-90bba852b7d1 Nov 03 08:21:40 devstack sudo[96010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:40 devstack sudo[96008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33__dnkxds9devstack@QuobyteHD Nov 03 08:21:40 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:40 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33__dnkxds9devstack@QuobyteHD" returned: 0 in 0.344s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1974030081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c3315e-bb40-4101-a420-83d96295a953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='818c120b75514b93b307f6d125eb8a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:21:39Z,use_quota=True,user_id='fece67ec285544428d9402417a2bfc2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Creating volume f7c3315e-bb40-4101-a420-83d96295a953 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:21:40 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7c3315e-bb40-4101-a420-83d96295a953 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:40 devstack sudo[96010]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-abd62112-4863-480c-ad44-dd2f9a580744 tempest-VolumesServicesTestJSON-1234699856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0b999ed-d058-44a8-88eb-90bba852b7d1" returned: 0 in 0.280s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:40 devstack sudo[96017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7c3315e-bb40-4101-a420-83d96295a953 1073741824 Nov 03 08:21:40 devstack sudo[96017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-abd62112-4863-480c-ad44-dd2f9a580744 tempest-VolumesServicesTestJSON-1234699856 None] Lock "cinder-quobyte-f0b999ed-d058-44a8-88eb-90bba852b7d1" released by "delete_volume" :: held 0.795s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-abd62112-4863-480c-ad44-dd2f9a580744 tempest-VolumesServicesTestJSON-1234699856 None] Created reservations ['4e374c07-6dd1-4f87-b05d-6a0cf9f2930b', '9f63bd4f-54b4-421c-b6dc-5c4f0044db8e', 'ca197cf9-6254-4a98-a5ef-50e54892626e', '96d14344-f863-4c76-9b2f-0faf24f0232f'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-abd62112-4863-480c-ad44-dd2f9a580744 tempest-VolumesServicesTestJSON-1234699856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-abd62112-4863-480c-ad44-dd2f9a580744 tempest-VolumesServicesTestJSON-1234699856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-abd62112-4863-480c-ad44-dd2f9a580744 tempest-VolumesServicesTestJSON-1234699856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:21:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-abd62112-4863-480c-ad44-dd2f9a580744 tempest-VolumesServicesTestJSON-1234699856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:21:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-abd62112-4863-480c-ad44-dd2f9a580744 tempest-VolumesServicesTestJSON-1234699856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-abd62112-4863-480c-ad44-dd2f9a580744 tempest-VolumesServicesTestJSON-1234699856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:41 devstack sudo[96019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:21:41 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:41 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-abd62112-4863-480c-ad44-dd2f9a580744 tempest-VolumesServicesTestJSON-1234699856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.332s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:41 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-abd62112-4863-480c-ad44-dd2f9a580744 tempest-VolumesServicesTestJSON-1234699856 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:21:41 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-abd62112-4863-480c-ad44-dd2f9a580744 tempest-VolumesServicesTestJSON-1234699856 None] Deleted volume successfully. Nov 03 08:21:41 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-abd62112-4863-480c-ad44-dd2f9a580744 tempest-VolumesServicesTestJSON-1234699856 None] Lock "cinder-f0b999ed-d058-44a8-88eb-90bba852b7d1-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:41 devstack sudo[96017]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7c3315e-bb40-4101-a420-83d96295a953 1073741824" returned: 0 in 0.677s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7c3315e-bb40-4101-a420-83d96295a953 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:41 devstack sudo[96025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7c3315e-bb40-4101-a420-83d96295a953 Nov 03 08:21:41 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-812cd24b-f64c-4815-bcd9-59c4f12acc29 tempest-SnapshotsActionsTest-14198360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:41 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7c3315e-bb40-4101-a420-83d96295a953" returned: 0 in 0.293s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:21:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-812cd24b-f64c-4815-bcd9-59c4f12acc29 tempest-SnapshotsActionsTest-14198360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.256s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-812cd24b-f64c-4815-bcd9-59c4f12acc29 tempest-SnapshotsActionsTest-14198360 None] Creating offline snapshot 658e3362-de01-48d1-8d3a-8e1099ffe55a of volume 1b649550-d019-4ffa-bff6-338be3c86033 {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:21:41 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Attempting download of 9eb5e936-be4c-46be-8de8-899e9fc38d33 ((None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}])) to volume f7c3315e-bb40-4101-a420-83d96295a953. {{(pid=86801) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 08:21:41 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ec8b06-c4e5-4b59-a304-1d61e1f423ff]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-812cd24b-f64c-4815-bcd9-59c4f12acc29 tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:42 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a1cda6-27f3-4d33-8ff4-293f64022da2]: (4, 'raw') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_lhsq_5fi {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:42 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb Nov 03 08:21:42 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:42 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_lhsq_5fi Nov 03 08:21:42 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:42 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-812cd24b-f64c-4815-bcd9-59c4f12acc29 tempest-SnapshotsActionsTest-14198360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb" returned: 0 in 0.448s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:42 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-812cd24b-f64c-4815-bcd9-59c4f12acc29 tempest-SnapshotsActionsTest-14198360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b649550-d019-4ffa-bff6-338be3c86033(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:21:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-812cd24b-f64c-4815-bcd9-59c4f12acc29 tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.658e3362-de01-48d1-8d3a-8e1099ffe55a 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:42 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.658e3362-de01-48d1-8d3a-8e1099ffe55a 1G Nov 03 08:21:42 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:42 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_lhsq_5fi" returned: 0 in 0.460s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_lhsq_5fi {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:42 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_lhsq_5fi Nov 03 08:21:42 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:42 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_lhsq_5fi" returned: 1 in 0.419s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_lhsq_5fi' failed. Not Retrying. {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 08:21:42 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c1422c-8ed6-4845-9c5f-2919fdee2e41]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33__dnkxds9devstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:42 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-812cd24b-f64c-4815-bcd9-59c4f12acc29 tempest-SnapshotsActionsTest-14198360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.658e3362-de01-48d1-8d3a-8e1099ffe55a 1G" returned: 0 in 0.595s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-812cd24b-f64c-4815-bcd9-59c4f12acc29 tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.658e3362-de01-48d1-8d3a-8e1099ffe55a {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:43 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33__dnkxds9devstack@QuobyteHD Nov 03 08:21:43 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:43 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.658e3362-de01-48d1-8d3a-8e1099ffe55a Nov 03 08:21:43 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:43 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33__dnkxds9devstack@QuobyteHD" returned: 0 in 0.412s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:43 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] 9eb5e936-be4c-46be-8de8-899e9fc38d33 was qcow2, converting to qcow2 {{(pid=86801) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 08:21:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33__dnkxds9devstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7c3315e-bb40-4101-a420-83d96295a953 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:43 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-812cd24b-f64c-4815-bcd9-59c4f12acc29 tempest-SnapshotsActionsTest-14198360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.658e3362-de01-48d1-8d3a-8e1099ffe55a" returned: 0 in 0.349s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:43 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-812cd24b-f64c-4815-bcd9-59c4f12acc29 tempest-SnapshotsActionsTest-14198360 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.658e3362-de01-48d1-8d3a-8e1099ffe55a is being set with open permissions: ugo+rw Nov 03 08:21:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-812cd24b-f64c-4815-bcd9-59c4f12acc29 tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.658e3362-de01-48d1-8d3a-8e1099ffe55a {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:43 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33__dnkxds9devstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7c3315e-bb40-4101-a420-83d96295a953 Nov 03 08:21:43 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:43 devstack sudo[96060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.658e3362-de01-48d1-8d3a-8e1099ffe55a Nov 03 08:21:43 devstack sudo[96060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:43 devstack sudo[96060]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-812cd24b-f64c-4815-bcd9-59c4f12acc29 tempest-SnapshotsActionsTest-14198360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.658e3362-de01-48d1-8d3a-8e1099ffe55a" returned: 0 in 0.304s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-812cd24b-f64c-4815-bcd9-59c4f12acc29 tempest-SnapshotsActionsTest-14198360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.867s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:43 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-812cd24b-f64c-4815-bcd9-59c4f12acc29 tempest-SnapshotsActionsTest-14198360 None] Create snapshot completed successfully Nov 03 08:21:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5d707bbb-161a-4e30-b6fd-7eb3531eaef6 tempest-SnapshotsActionsTest-433722804 None] Acquiring lock "cinder-658e3362-de01-48d1-8d3a-8e1099ffe55a-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5d707bbb-161a-4e30-b6fd-7eb3531eaef6 tempest-SnapshotsActionsTest-433722804 None] Lock "cinder-658e3362-de01-48d1-8d3a-8e1099ffe55a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5d707bbb-161a-4e30-b6fd-7eb3531eaef6 tempest-SnapshotsActionsTest-433722804 None] Acquiring lock "cinder-quobyte-1b649550-d019-4ffa-bff6-338be3c86033" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5d707bbb-161a-4e30-b6fd-7eb3531eaef6 tempest-SnapshotsActionsTest-433722804 None] Lock "cinder-quobyte-1b649550-d019-4ffa-bff6-338be3c86033" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5d707bbb-161a-4e30-b6fd-7eb3531eaef6 tempest-SnapshotsActionsTest-433722804 None] Acquiring lock "cinder-quobyte-658e3362-de01-48d1-8d3a-8e1099ffe55a" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5d707bbb-161a-4e30-b6fd-7eb3531eaef6 tempest-SnapshotsActionsTest-433722804 None] Lock "cinder-quobyte-658e3362-de01-48d1-8d3a-8e1099ffe55a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:44 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-5d707bbb-161a-4e30-b6fd-7eb3531eaef6 tempest-SnapshotsActionsTest-433722804 None] Deleting offline snapshot 658e3362-de01-48d1-8d3a-8e1099ffe55a of volume 1b649550-d019-4ffa-bff6-338be3c86033 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:21:45 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-5d707bbb-161a-4e30-b6fd-7eb3531eaef6 tempest-SnapshotsActionsTest-433722804 None] snapshot_file for this snap is: volume-1b649550-d019-4ffa-bff6-338be3c86033.658e3362-de01-48d1-8d3a-8e1099ffe55a {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:21:45 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f78291b-e2f3-4cf8-924e-86330d05bf6d]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5d707bbb-161a-4e30-b6fd-7eb3531eaef6 tempest-SnapshotsActionsTest-433722804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.658e3362-de01-48d1-8d3a-8e1099ffe55a {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:45 devstack sudo[96072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.658e3362-de01-48d1-8d3a-8e1099ffe55a Nov 03 08:21:45 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:45 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5d707bbb-161a-4e30-b6fd-7eb3531eaef6 tempest-SnapshotsActionsTest-433722804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.658e3362-de01-48d1-8d3a-8e1099ffe55a" returned: 0 in 0.523s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:45 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-5d707bbb-161a-4e30-b6fd-7eb3531eaef6 tempest-SnapshotsActionsTest-433722804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b649550-d019-4ffa-bff6-338be3c86033(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:21:45 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab32cb33-2f5a-402d-a8a7-4b719557effe]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5d707bbb-161a-4e30-b6fd-7eb3531eaef6 tempest-SnapshotsActionsTest-433722804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:45 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb Nov 03 08:21:45 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:45 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33__dnkxds9devstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7c3315e-bb40-4101-a420-83d96295a953" returned: 0 in 2.518s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:45 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33__dnkxds9devstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7c3315e-bb40-4101-a420-83d96295a953 {{(pid=86801) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 08:21:45 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Converted 112.00 MB image at 44.46 MB/s Nov 03 08:21:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7c3315e-bb40-4101-a420-83d96295a953 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:45 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7c3315e-bb40-4101-a420-83d96295a953 1G Nov 03 08:21:45 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:46 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5d707bbb-161a-4e30-b6fd-7eb3531eaef6 tempest-SnapshotsActionsTest-433722804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb" returned: 0 in 0.509s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-5d707bbb-161a-4e30-b6fd-7eb3531eaef6 tempest-SnapshotsActionsTest-433722804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b649550-d019-4ffa-bff6-338be3c86033(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:21:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5d707bbb-161a-4e30-b6fd-7eb3531eaef6 tempest-SnapshotsActionsTest-433722804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.658e3362-de01-48d1-8d3a-8e1099ffe55a {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:46 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.658e3362-de01-48d1-8d3a-8e1099ffe55a Nov 03 08:21:46 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:46 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7c3315e-bb40-4101-a420-83d96295a953 1G" returned: 0 in 0.384s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:46 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Downloaded image 9eb5e936-be4c-46be-8de8-899e9fc38d33 ((None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}])) to volume f7c3315e-bb40-4101-a420-83d96295a953 successfully. {{(pid=86801) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 08:21:46 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Temporary image 9eb5e936-be4c-46be-8de8-899e9fc38d33 for user fece67ec285544428d9402417a2bfc2a is deleted. {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 08:21:46 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Marking volume f7c3315e-bb40-4101-a420-83d96295a953 as bootable. {{(pid=86801) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 08:21:46 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Copying metadata from image 9eb5e936-be4c-46be-8de8-899e9fc38d33 to f7c3315e-bb40-4101-a420-83d96295a953. {{(pid=86801) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 08:21:46 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Creating volume glance metadata for volume f7c3315e-bb40-4101-a420-83d96295a953 backed by image 9eb5e936-be4c-46be-8de8-899e9fc38d33 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86801) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 08:21:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ddc0c96-d498-4f34-b5ec-5918aa9cc70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7c3315e-bb40-4101-a420-83d96295a953', 'volume_size': 1, 'image_id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02c779626a284994918db1738b55fe79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'created_at': datetime.datetime(2026, 11, 3, 7, 8, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 8, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9eb5e936-be4c-46be-8de8-899e9fc38d33/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23343e68-f688-4c3d-b301-ff6c573a2468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:46 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Volume volume-f7c3315e-bb40-4101-a420-83d96295a953 (f7c3315e-bb40-4101-a420-83d96295a953): created successfully Nov 03 08:21:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23343e68-f688-4c3d-b301-ff6c573a2468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Flow 'volume_create_manager' (acaa7f42-8573-4267-97ac-4349150bf094) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:21:46 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-48c9e136-e686-4146-8a33-279ee4fcc785 tempest-VolumesImageMetadata-1255379308 None] Created volume successfully. Nov 03 08:21:46 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5d707bbb-161a-4e30-b6fd-7eb3531eaef6 tempest-SnapshotsActionsTest-433722804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.658e3362-de01-48d1-8d3a-8e1099ffe55a" returned: 0 in 0.523s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5d707bbb-161a-4e30-b6fd-7eb3531eaef6 tempest-SnapshotsActionsTest-433722804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.658e3362-de01-48d1-8d3a-8e1099ffe55a {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:46 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.658e3362-de01-48d1-8d3a-8e1099ffe55a Nov 03 08:21:46 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:47 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5d707bbb-161a-4e30-b6fd-7eb3531eaef6 tempest-SnapshotsActionsTest-433722804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.658e3362-de01-48d1-8d3a-8e1099ffe55a" returned: 0 in 0.482s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5d707bbb-161a-4e30-b6fd-7eb3531eaef6 tempest-SnapshotsActionsTest-433722804 None] Lock "cinder-quobyte-658e3362-de01-48d1-8d3a-8e1099ffe55a" released by "_delete_snapshot" :: held 2.197s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5d707bbb-161a-4e30-b6fd-7eb3531eaef6 tempest-SnapshotsActionsTest-433722804 None] Lock "cinder-quobyte-1b649550-d019-4ffa-bff6-338be3c86033" released by "delete_snapshot" :: held 2.233s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:47 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-5d707bbb-161a-4e30-b6fd-7eb3531eaef6 tempest-SnapshotsActionsTest-433722804 None] Created reservations ['128a5ce0-acba-45c9-8edd-bd1534798448', '39039e25-1a13-40a3-ab4d-705afc15fffe', '021fc1d2-a1de-4106-acab-a8e76d0f1e80', 'a5331cac-ad41-4e41-bd40-748cf262419a'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:21:47 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-5d707bbb-161a-4e30-b6fd-7eb3531eaef6 tempest-SnapshotsActionsTest-433722804 None] Delete snapshot completed successfully. Nov 03 08:21:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5d707bbb-161a-4e30-b6fd-7eb3531eaef6 tempest-SnapshotsActionsTest-433722804 None] Lock "cinder-658e3362-de01-48d1-8d3a-8e1099ffe55a-delete_snapshot" released by "delete_snapshot" :: held 2.480s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ae7a0044-a9c2-4684-8df8-4c5a3758679f tempest-VolumesImageMetadata-1255379308 None] Acquiring lock "cinder-f7c3315e-bb40-4101-a420-83d96295a953-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ae7a0044-a9c2-4684-8df8-4c5a3758679f tempest-VolumesImageMetadata-1255379308 None] Lock "cinder-f7c3315e-bb40-4101-a420-83d96295a953-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ae7a0044-a9c2-4684-8df8-4c5a3758679f tempest-VolumesImageMetadata-1255379308 None] Acquiring lock "cinder-quobyte-f7c3315e-bb40-4101-a420-83d96295a953" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ae7a0044-a9c2-4684-8df8-4c5a3758679f tempest-VolumesImageMetadata-1255379308 None] Lock "cinder-quobyte-f7c3315e-bb40-4101-a420-83d96295a953" acquired by "delete_volume" :: waited 0.015s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:47 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1092f01-8efc-491e-869a-f2e7297b2467]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ae7a0044-a9c2-4684-8df8-4c5a3758679f tempest-VolumesImageMetadata-1255379308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7c3315e-bb40-4101-a420-83d96295a953 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:47 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7c3315e-bb40-4101-a420-83d96295a953 Nov 03 08:21:47 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:48 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ae7a0044-a9c2-4684-8df8-4c5a3758679f tempest-VolumesImageMetadata-1255379308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7c3315e-bb40-4101-a420-83d96295a953" returned: 0 in 0.428s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ae7a0044-a9c2-4684-8df8-4c5a3758679f tempest-VolumesImageMetadata-1255379308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7c3315e-bb40-4101-a420-83d96295a953 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:48 devstack sudo[96104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7c3315e-bb40-4101-a420-83d96295a953 Nov 03 08:21:48 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:48 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ae7a0044-a9c2-4684-8df8-4c5a3758679f tempest-VolumesImageMetadata-1255379308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7c3315e-bb40-4101-a420-83d96295a953" returned: 0 in 0.404s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:48 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ae7a0044-a9c2-4684-8df8-4c5a3758679f tempest-VolumesImageMetadata-1255379308 None] Lock "cinder-quobyte-f7c3315e-bb40-4101-a420-83d96295a953" released by "delete_volume" :: held 0.892s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:48 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-ae7a0044-a9c2-4684-8df8-4c5a3758679f tempest-VolumesImageMetadata-1255379308 None] Created reservations ['6ffc7683-b795-4b91-ab5d-9fc0d26b09d9', '9e5b7103-3702-463d-a154-b5301ac9b046', '5bfd3da8-1df2-4eb5-b1e8-b9496bf9bbaf', '03ac16db-c579-4921-85c7-3ae030c3da97'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:21:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ae7a0044-a9c2-4684-8df8-4c5a3758679f tempest-VolumesImageMetadata-1255379308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ae7a0044-a9c2-4684-8df8-4c5a3758679f tempest-VolumesImageMetadata-1255379308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ae7a0044-a9c2-4684-8df8-4c5a3758679f tempest-VolumesImageMetadata-1255379308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:21:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ae7a0044-a9c2-4684-8df8-4c5a3758679f tempest-VolumesImageMetadata-1255379308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:21:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ae7a0044-a9c2-4684-8df8-4c5a3758679f tempest-VolumesImageMetadata-1255379308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ae7a0044-a9c2-4684-8df8-4c5a3758679f tempest-VolumesImageMetadata-1255379308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:48 devstack sudo[96107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:21:48 devstack sudo[96107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4f42f348-3aaf-465c-893a-4ff240cb90bb tempest-SnapshotsActionsTest-14198360 None] Acquiring lock "cinder-3302045f-6c7a-483a-b471-195e91a85ccb-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4f42f348-3aaf-465c-893a-4ff240cb90bb tempest-SnapshotsActionsTest-14198360 None] Lock "cinder-3302045f-6c7a-483a-b471-195e91a85ccb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4f42f348-3aaf-465c-893a-4ff240cb90bb tempest-SnapshotsActionsTest-14198360 None] Acquiring lock "cinder-quobyte-1b649550-d019-4ffa-bff6-338be3c86033" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4f42f348-3aaf-465c-893a-4ff240cb90bb tempest-SnapshotsActionsTest-14198360 None] Lock "cinder-quobyte-1b649550-d019-4ffa-bff6-338be3c86033" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4f42f348-3aaf-465c-893a-4ff240cb90bb tempest-SnapshotsActionsTest-14198360 None] Acquiring lock "cinder-quobyte-3302045f-6c7a-483a-b471-195e91a85ccb" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:49 devstack sudo[96107]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ae7a0044-a9c2-4684-8df8-4c5a3758679f tempest-VolumesImageMetadata-1255379308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.383s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-ae7a0044-a9c2-4684-8df8-4c5a3758679f tempest-VolumesImageMetadata-1255379308 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:21:49 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-ae7a0044-a9c2-4684-8df8-4c5a3758679f tempest-VolumesImageMetadata-1255379308 None] Deleted volume successfully. Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4f42f348-3aaf-465c-893a-4ff240cb90bb tempest-SnapshotsActionsTest-14198360 None] Lock "cinder-quobyte-3302045f-6c7a-483a-b471-195e91a85ccb" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-4f42f348-3aaf-465c-893a-4ff240cb90bb tempest-SnapshotsActionsTest-14198360 None] Deleting offline snapshot 3302045f-6c7a-483a-b471-195e91a85ccb of volume 1b649550-d019-4ffa-bff6-338be3c86033 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-4f42f348-3aaf-465c-893a-4ff240cb90bb tempest-SnapshotsActionsTest-14198360 None] snapshot_file for this snap is: volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ae7a0044-a9c2-4684-8df8-4c5a3758679f tempest-VolumesImageMetadata-1255379308 None] Lock "cinder-f7c3315e-bb40-4101-a420-83d96295a953-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[5246310e-1030-4fa3-a39d-d5660ff12fee]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4f42f348-3aaf-465c-893a-4ff240cb90bb tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:49 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb Nov 03 08:21:49 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Flow 'volume_create_manager' (fa9db0c4-d146-4c68-8926-d2f069081731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5c6135-8e42-46f6-b3dc-bd322349d1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5c6135-8e42-46f6-b3dc-bd322349d1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-737427830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67d60295-e790-4eb1-84bc-12657590fc54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbf1d6a004042a7a519e2dd8f58ea70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:21:50Z,use_quota=True,user_id='a94f331684ab438f9dec8be67942973a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0299fc67-c843-418e-8791-07a8de17c56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0299fc67-c843-418e-8791-07a8de17c56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:49 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc9f881-11a1-4f52-90ff-15bf924e6f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc9f881-11a1-4f52-90ff-15bf924e6f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67d60295-e790-4eb1-84bc-12657590fc54', 'volume_name': 'volume-67d60295-e790-4eb1-84bc-12657590fc54', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (facf10ff-553b-4c60-b511-b6ecf3f27d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (facf10ff-553b-4c60-b511-b6ecf3f27d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f908475c-ba3a-4352-9ae9-44837be235c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:49 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Volume 67d60295-e790-4eb1-84bc-12657590fc54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67d60295-e790-4eb1-84bc-12657590fc54', 'volume_size': 1} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-737427830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67d60295-e790-4eb1-84bc-12657590fc54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbf1d6a004042a7a519e2dd8f58ea70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:21:50Z,use_quota=True,user_id='a94f331684ab438f9dec8be67942973a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Creating volume 67d60295-e790-4eb1-84bc-12657590fc54 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:21:49 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4f42f348-3aaf-465c-893a-4ff240cb90bb tempest-SnapshotsActionsTest-14198360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb" returned: 0 in 0.545s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-4f42f348-3aaf-465c-893a-4ff240cb90bb tempest-SnapshotsActionsTest-14198360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b649550-d019-4ffa-bff6-338be3c86033(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:21:49 devstack sudo[96116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54 1073741824 Nov 03 08:21:49 devstack sudo[96116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3f7d05-fcc3-466e-8819-915b306b06ce]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4f42f348-3aaf-465c-893a-4ff240cb90bb tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:49 devstack sudo[96118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033 Nov 03 08:21:49 devstack sudo[96118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:50 devstack sudo[96118]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4f42f348-3aaf-465c-893a-4ff240cb90bb tempest-SnapshotsActionsTest-14198360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033" returned: 0 in 0.473s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4f42f348-3aaf-465c-893a-4ff240cb90bb tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:50 devstack sudo[96116]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:50 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb Nov 03 08:21:50 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54 1073741824" returned: 0 in 0.576s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:50 devstack sudo[96129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54 Nov 03 08:21:50 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:50 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54" returned: 0 in 0.392s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:50 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:21:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:50 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4f42f348-3aaf-465c-893a-4ff240cb90bb tempest-SnapshotsActionsTest-14198360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb" returned: 0 in 0.505s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4f42f348-3aaf-465c-893a-4ff240cb90bb tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:50 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f908475c-ba3a-4352-9ae9-44837be235c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67d60295-e790-4eb1-84bc-12657590fc54', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:50 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fbed8e9-e774-4445-a067-b379fd5fec1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:50 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb Nov 03 08:21:50 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:50 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Volume volume-67d60295-e790-4eb1-84bc-12657590fc54 (67d60295-e790-4eb1-84bc-12657590fc54): created successfully Nov 03 08:21:50 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fbed8e9-e774-4445-a067-b379fd5fec1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:50 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Flow 'volume_create_manager' (fa9db0c4-d146-4c68-8926-d2f069081731) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:21:50 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-8816833e-72d1-4026-b8d0-8f418217ff83 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Created volume successfully. Nov 03 08:21:51 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4f42f348-3aaf-465c-893a-4ff240cb90bb tempest-SnapshotsActionsTest-14198360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033.3302045f-6c7a-483a-b471-195e91a85ccb" returned: 0 in 0.322s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:51 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4f42f348-3aaf-465c-893a-4ff240cb90bb tempest-SnapshotsActionsTest-14198360 None] Lock "cinder-quobyte-3302045f-6c7a-483a-b471-195e91a85ccb" released by "_delete_snapshot" :: held 2.021s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:51 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4f42f348-3aaf-465c-893a-4ff240cb90bb tempest-SnapshotsActionsTest-14198360 None] Lock "cinder-quobyte-1b649550-d019-4ffa-bff6-338be3c86033" released by "delete_snapshot" :: held 2.080s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:51 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-4f42f348-3aaf-465c-893a-4ff240cb90bb tempest-SnapshotsActionsTest-14198360 None] Created reservations ['cf76cbe1-cd2a-403c-b105-dd73ac61fd4d', 'a2a7eec2-f679-473d-8a94-e754c6811336', 'e3ba86bb-61b4-4b25-a2ee-631c49306460', 'f334328f-0d0b-42a8-be85-fe00bd3d7fa8'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:21:51 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-4f42f348-3aaf-465c-893a-4ff240cb90bb tempest-SnapshotsActionsTest-14198360 None] Delete snapshot completed successfully. Nov 03 08:21:51 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4f42f348-3aaf-465c-893a-4ff240cb90bb tempest-SnapshotsActionsTest-14198360 None] Lock "cinder-3302045f-6c7a-483a-b471-195e91a85ccb-delete_snapshot" released by "delete_snapshot" :: held 2.293s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-39d07763-71cb-4833-a29a-b8f2206a8cb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-39d07763-71cb-4833-a29a-b8f2206a8cb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:51 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-39d07763-71cb-4833-a29a-b8f2206a8cb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Creating offline snapshot 5eacea65-1a6e-4a10-b933-22bb7e0e6679 of volume 67d60295-e790-4eb1-84bc-12657590fc54 {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:21:51 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acbf269-3374-4e84-8e6f-722ada1f6ac1]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-39d07763-71cb-4833-a29a-b8f2206a8cb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:52 devstack sudo[96139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54 Nov 03 08:21:52 devstack sudo[96139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:52 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0b4e1a4b-97af-405d-b486-6109ee34e0ae tempest-SnapshotsActionsTest-14198360 None] Acquiring lock "cinder-1b649550-d019-4ffa-bff6-338be3c86033-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:52 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0b4e1a4b-97af-405d-b486-6109ee34e0ae tempest-SnapshotsActionsTest-14198360 None] Lock "cinder-1b649550-d019-4ffa-bff6-338be3c86033-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:52 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0b4e1a4b-97af-405d-b486-6109ee34e0ae tempest-SnapshotsActionsTest-14198360 None] Acquiring lock "cinder-quobyte-1b649550-d019-4ffa-bff6-338be3c86033" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:52 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0b4e1a4b-97af-405d-b486-6109ee34e0ae tempest-SnapshotsActionsTest-14198360 None] Lock "cinder-quobyte-1b649550-d019-4ffa-bff6-338be3c86033" acquired by "delete_volume" :: waited 0.016s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:52 devstack sudo[96139]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-39d07763-71cb-4833-a29a-b8f2206a8cb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54" returned: 0 in 0.574s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-39d07763-71cb-4833-a29a-b8f2206a8cb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54.5eacea65-1a6e-4a10-b933-22bb7e0e6679 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:52 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae2fa6f-c8f8-4c9a-b9f3-96f152b946a3]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0b4e1a4b-97af-405d-b486-6109ee34e0ae tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:52 devstack sudo[96145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54.5eacea65-1a6e-4a10-b933-22bb7e0e6679 1G Nov 03 08:21:52 devstack sudo[96145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:52 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033 Nov 03 08:21:52 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:53 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0b4e1a4b-97af-405d-b486-6109ee34e0ae tempest-SnapshotsActionsTest-14198360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033" returned: 0 in 0.665s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0b4e1a4b-97af-405d-b486-6109ee34e0ae tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:53 devstack sudo[96145]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-39d07763-71cb-4833-a29a-b8f2206a8cb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54.5eacea65-1a6e-4a10-b933-22bb7e0e6679 1G" returned: 0 in 0.725s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-39d07763-71cb-4833-a29a-b8f2206a8cb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67d60295-e790-4eb1-84bc-12657590fc54 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54.5eacea65-1a6e-4a10-b933-22bb7e0e6679 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:53 devstack sudo[96156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033 Nov 03 08:21:53 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:53 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67d60295-e790-4eb1-84bc-12657590fc54 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54.5eacea65-1a6e-4a10-b933-22bb7e0e6679 Nov 03 08:21:53 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:53 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-39d07763-71cb-4833-a29a-b8f2206a8cb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67d60295-e790-4eb1-84bc-12657590fc54 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54.5eacea65-1a6e-4a10-b933-22bb7e0e6679" returned: 0 in 0.394s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:53 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-39d07763-71cb-4833-a29a-b8f2206a8cb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54.5eacea65-1a6e-4a10-b933-22bb7e0e6679 is being set with open permissions: ugo+rw Nov 03 08:21:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-39d07763-71cb-4833-a29a-b8f2206a8cb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54.5eacea65-1a6e-4a10-b933-22bb7e0e6679 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:53 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0b4e1a4b-97af-405d-b486-6109ee34e0ae tempest-SnapshotsActionsTest-14198360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1b649550-d019-4ffa-bff6-338be3c86033" returned: 0 in 0.453s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:53 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54.5eacea65-1a6e-4a10-b933-22bb7e0e6679 Nov 03 08:21:53 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:53 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0b4e1a4b-97af-405d-b486-6109ee34e0ae tempest-SnapshotsActionsTest-14198360 None] Lock "cinder-quobyte-1b649550-d019-4ffa-bff6-338be3c86033" released by "delete_volume" :: held 1.255s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:53 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-0b4e1a4b-97af-405d-b486-6109ee34e0ae tempest-SnapshotsActionsTest-14198360 None] Created reservations ['0d5e36f9-31e1-4912-96b8-d6a99cd9a697', 'c0146355-63d0-4680-a792-fc71534575c3', '43a6d7fd-419d-4489-b57d-f3b40d0084f3', 'a0fe2355-1e02-45ed-b4d1-7aa54ecac06d'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0b4e1a4b-97af-405d-b486-6109ee34e0ae tempest-SnapshotsActionsTest-14198360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0b4e1a4b-97af-405d-b486-6109ee34e0ae tempest-SnapshotsActionsTest-14198360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0b4e1a4b-97af-405d-b486-6109ee34e0ae tempest-SnapshotsActionsTest-14198360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0b4e1a4b-97af-405d-b486-6109ee34e0ae tempest-SnapshotsActionsTest-14198360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0b4e1a4b-97af-405d-b486-6109ee34e0ae tempest-SnapshotsActionsTest-14198360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0b4e1a4b-97af-405d-b486-6109ee34e0ae tempest-SnapshotsActionsTest-14198360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:54 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-39d07763-71cb-4833-a29a-b8f2206a8cb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54.5eacea65-1a6e-4a10-b933-22bb7e0e6679" returned: 0 in 0.426s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:54 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:21:54 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-39d07763-71cb-4833-a29a-b8f2206a8cb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:54 devstack sudo[96169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54.info Nov 03 08:21:54 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:54 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0b4e1a4b-97af-405d-b486-6109ee34e0ae tempest-SnapshotsActionsTest-14198360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.407s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-0b4e1a4b-97af-405d-b486-6109ee34e0ae tempest-SnapshotsActionsTest-14198360 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:21:54 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-0b4e1a4b-97af-405d-b486-6109ee34e0ae tempest-SnapshotsActionsTest-14198360 None] Deleted volume successfully. Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:21:54 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Flow 'volume_create_manager' (c2e0e495-4ba9-44ac-a964-0681c5c830c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d29eb8-eb17-4a9f-8239-6d6d62b32151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-39d07763-71cb-4833-a29a-b8f2206a8cb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54.info" returned: 0 in 0.400s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:54 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-39d07763-71cb-4833-a29a-b8f2206a8cb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54.info is being set with open permissions: ugo+rw Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-39d07763-71cb-4833-a29a-b8f2206a8cb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:54 devstack sudo[96173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54.info Nov 03 08:21:54 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d29eb8-eb17-4a9f-8239-6d6d62b32151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1448378372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff1ebe9c-8653-45d2-aaa3-563240127fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abfabe0cce0c4fa4a620eb30dd2a90e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:21:54Z,use_quota=True,user_id='2a0c9b4f058a45d98c947be6ef9fc125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0e35e8-eb69-428e-8231-d727ea596466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0e35e8-eb69-428e-8231-d727ea596466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64294a3a-d2d0-47c5-a934-331ae0eee68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64294a3a-d2d0-47c5-a934-331ae0eee68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff1ebe9c-8653-45d2-aaa3-563240127fbb', 'volume_name': 'volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fae7527-c8a6-4612-bc74-aedef79ecce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fae7527-c8a6-4612-bc74-aedef79ecce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1d2889-a6f7-4be4-89d9-d937b3822065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:54 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Volume ff1ebe9c-8653-45d2-aaa3-563240127fbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb', 'volume_size': 1} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0b4e1a4b-97af-405d-b486-6109ee34e0ae tempest-SnapshotsActionsTest-14198360 None] Lock "cinder-1b649550-d019-4ffa-bff6-338be3c86033-delete_volume" released by "delete_volume" :: held 2.243s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:54 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-39d07763-71cb-4833-a29a-b8f2206a8cb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54.info" returned: 0 in 0.270s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-39d07763-71cb-4833-a29a-b8f2206a8cb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.918s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.219s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1448378372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff1ebe9c-8653-45d2-aaa3-563240127fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abfabe0cce0c4fa4a620eb30dd2a90e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:21:54Z,use_quota=True,user_id='2a0c9b4f058a45d98c947be6ef9fc125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Creating volume ff1ebe9c-8653-45d2-aaa3-563240127fbb {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:21:54 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=131,cinder:UPDATE=170,cinder:INSERT=46,cinder:DELETE=8 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:21:54 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb 1073741824 Nov 03 08:21:54 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:54 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:UPDATE=147,cinder:DELETE=16,cinder:SELECT=132,cinder:INSERT=47 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:21:54 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-39d07763-71cb-4833-a29a-b8f2206a8cb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Create snapshot completed successfully Nov 03 08:21:55 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb 1073741824" returned: 0 in 0.580s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:55 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb Nov 03 08:21:55 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:55 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-888ba984-6739-499d-bec9-4c22a2f0df17 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Acquiring lock "cinder-5eacea65-1a6e-4a10-b933-22bb7e0e6679-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:55 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-888ba984-6739-499d-bec9-4c22a2f0df17 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Lock "cinder-5eacea65-1a6e-4a10-b933-22bb7e0e6679-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:55 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-888ba984-6739-499d-bec9-4c22a2f0df17 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Acquiring lock "cinder-quobyte-67d60295-e790-4eb1-84bc-12657590fc54" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:55 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-888ba984-6739-499d-bec9-4c22a2f0df17 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Lock "cinder-quobyte-67d60295-e790-4eb1-84bc-12657590fc54" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:55 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-888ba984-6739-499d-bec9-4c22a2f0df17 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Acquiring lock "cinder-quobyte-5eacea65-1a6e-4a10-b933-22bb7e0e6679" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:55 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-888ba984-6739-499d-bec9-4c22a2f0df17 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Lock "cinder-quobyte-5eacea65-1a6e-4a10-b933-22bb7e0e6679" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:55 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-888ba984-6739-499d-bec9-4c22a2f0df17 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Deleting offline snapshot 5eacea65-1a6e-4a10-b933-22bb7e0e6679 of volume 67d60295-e790-4eb1-84bc-12657590fc54 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:21:55 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-888ba984-6739-499d-bec9-4c22a2f0df17 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] snapshot_file for this snap is: volume-67d60295-e790-4eb1-84bc-12657590fc54.5eacea65-1a6e-4a10-b933-22bb7e0e6679 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:21:55 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04952f4-87a2-489b-88d5-f78207e56ff0]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-888ba984-6739-499d-bec9-4c22a2f0df17 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54.5eacea65-1a6e-4a10-b933-22bb7e0e6679 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:55 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb" returned: 0 in 0.359s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:55 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:21:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:55 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1d2889-a6f7-4be4-89d9-d937b3822065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:55 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ab112a-8563-4a1b-8532-8d18be093251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:21:55 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Volume volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb (ff1ebe9c-8653-45d2-aaa3-563240127fbb): created successfully Nov 03 08:21:55 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ab112a-8563-4a1b-8532-8d18be093251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:21:55 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Flow 'volume_create_manager' (c2e0e495-4ba9-44ac-a964-0681c5c830c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:21:55 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54.5eacea65-1a6e-4a10-b933-22bb7e0e6679 Nov 03 08:21:55 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:55 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-d8f137e7-4290-4dbb-8eeb-905a91b72fbe tempest-SnapshotMetadataTestJSON-2045906085 None] Created volume successfully. Nov 03 08:21:56 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-888ba984-6739-499d-bec9-4c22a2f0df17 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54.5eacea65-1a6e-4a10-b933-22bb7e0e6679" returned: 0 in 0.516s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:56 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-888ba984-6739-499d-bec9-4c22a2f0df17 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67d60295-e790-4eb1-84bc-12657590fc54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:21:56 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc80571-ea8d-4b4a-a857-71e975a57ea0]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-888ba984-6739-499d-bec9-4c22a2f0df17 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:56 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54 Nov 03 08:21:56 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:56 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-888ba984-6739-499d-bec9-4c22a2f0df17 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54" returned: 0 in 0.494s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-888ba984-6739-499d-bec9-4c22a2f0df17 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54.5eacea65-1a6e-4a10-b933-22bb7e0e6679 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:56 devstack sudo[96195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54.5eacea65-1a6e-4a10-b933-22bb7e0e6679 Nov 03 08:21:56 devstack sudo[96195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7da86bbf-fbb4-40c2-8298-8c27c49b7734 tempest-SnapshotMetadataTestJSON-2045906085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:21:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7da86bbf-fbb4-40c2-8298-8c27c49b7734 tempest-SnapshotMetadataTestJSON-2045906085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:21:56 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-7da86bbf-fbb4-40c2-8298-8c27c49b7734 tempest-SnapshotMetadataTestJSON-2045906085 None] Creating offline snapshot 7ca9fe5d-437c-4dc2-a8e5-2f6f618cbde3 of volume ff1ebe9c-8653-45d2-aaa3-563240127fbb {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:21:56 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc244a9-601f-4299-8967-434a0c7e6e66]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7da86bbf-fbb4-40c2-8298-8c27c49b7734 tempest-SnapshotMetadataTestJSON-2045906085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:57 devstack sudo[96197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb Nov 03 08:21:57 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:57 devstack sudo[96195]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-888ba984-6739-499d-bec9-4c22a2f0df17 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54.5eacea65-1a6e-4a10-b933-22bb7e0e6679" returned: 0 in 0.480s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-888ba984-6739-499d-bec9-4c22a2f0df17 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54.5eacea65-1a6e-4a10-b933-22bb7e0e6679 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:57 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54.5eacea65-1a6e-4a10-b933-22bb7e0e6679 Nov 03 08:21:57 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:57 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7da86bbf-fbb4-40c2-8298-8c27c49b7734 tempest-SnapshotMetadataTestJSON-2045906085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb" returned: 0 in 0.472s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7da86bbf-fbb4-40c2-8298-8c27c49b7734 tempest-SnapshotMetadataTestJSON-2045906085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb.7ca9fe5d-437c-4dc2-a8e5-2f6f618cbde3 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:57 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb.7ca9fe5d-437c-4dc2-a8e5-2f6f618cbde3 1G Nov 03 08:21:57 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:57 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-888ba984-6739-499d-bec9-4c22a2f0df17 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54.5eacea65-1a6e-4a10-b933-22bb7e0e6679" returned: 0 in 0.352s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:57 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-888ba984-6739-499d-bec9-4c22a2f0df17 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Lock "cinder-quobyte-5eacea65-1a6e-4a10-b933-22bb7e0e6679" released by "_delete_snapshot" :: held 2.023s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:57 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-888ba984-6739-499d-bec9-4c22a2f0df17 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Lock "cinder-quobyte-67d60295-e790-4eb1-84bc-12657590fc54" released by "delete_snapshot" :: held 2.050s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:57 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-888ba984-6739-499d-bec9-4c22a2f0df17 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Created reservations ['0aaed55b-7f85-4199-a232-bbdb08895dd3', '580dee19-3265-43e5-be6e-6f3238c55403', 'be777df2-3d2d-4fc6-b928-4b033efcfaad', '835f13bc-e67e-4a97-817f-3d8bb6ef7011'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:21:57 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-888ba984-6739-499d-bec9-4c22a2f0df17 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Delete snapshot completed successfully. Nov 03 08:21:57 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-888ba984-6739-499d-bec9-4c22a2f0df17 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Lock "cinder-5eacea65-1a6e-4a10-b933-22bb7e0e6679-delete_snapshot" released by "delete_snapshot" :: held 2.221s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:21:58 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7da86bbf-fbb4-40c2-8298-8c27c49b7734 tempest-SnapshotMetadataTestJSON-2045906085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb.7ca9fe5d-437c-4dc2-a8e5-2f6f618cbde3 1G" returned: 0 in 0.611s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7da86bbf-fbb4-40c2-8298-8c27c49b7734 tempest-SnapshotMetadataTestJSON-2045906085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb.7ca9fe5d-437c-4dc2-a8e5-2f6f618cbde3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:58 devstack sudo[96214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb.7ca9fe5d-437c-4dc2-a8e5-2f6f618cbde3 Nov 03 08:21:58 devstack sudo[96214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:58 devstack sudo[96214]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7da86bbf-fbb4-40c2-8298-8c27c49b7734 tempest-SnapshotMetadataTestJSON-2045906085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb.7ca9fe5d-437c-4dc2-a8e5-2f6f618cbde3" returned: 0 in 0.346s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:58 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-7da86bbf-fbb4-40c2-8298-8c27c49b7734 tempest-SnapshotMetadataTestJSON-2045906085 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb.7ca9fe5d-437c-4dc2-a8e5-2f6f618cbde3 is being set with open permissions: ugo+rw Nov 03 08:21:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7da86bbf-fbb4-40c2-8298-8c27c49b7734 tempest-SnapshotMetadataTestJSON-2045906085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb.7ca9fe5d-437c-4dc2-a8e5-2f6f618cbde3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:58 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb.7ca9fe5d-437c-4dc2-a8e5-2f6f618cbde3 Nov 03 08:21:58 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:58 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7da86bbf-fbb4-40c2-8298-8c27c49b7734 tempest-SnapshotMetadataTestJSON-2045906085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb.7ca9fe5d-437c-4dc2-a8e5-2f6f618cbde3" returned: 0 in 0.298s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7da86bbf-fbb4-40c2-8298-8c27c49b7734 tempest-SnapshotMetadataTestJSON-2045906085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:58 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb.info Nov 03 08:21:58 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:59 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-53dc4ea9-cb10-427f-8865-f88fa49f78d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Acquiring lock "cinder-67d60295-e790-4eb1-84bc-12657590fc54-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:59 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-53dc4ea9-cb10-427f-8865-f88fa49f78d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Lock "cinder-67d60295-e790-4eb1-84bc-12657590fc54-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:59 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-53dc4ea9-cb10-427f-8865-f88fa49f78d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Acquiring lock "cinder-quobyte-67d60295-e790-4eb1-84bc-12657590fc54" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:21:59 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-53dc4ea9-cb10-427f-8865-f88fa49f78d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Lock "cinder-quobyte-67d60295-e790-4eb1-84bc-12657590fc54" acquired by "delete_volume" :: waited 0.016s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:21:59 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[78db7c4a-1195-417e-bfcf-ab32feac7473]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:21:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-53dc4ea9-cb10-427f-8865-f88fa49f78d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:59 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7da86bbf-fbb4-40c2-8298-8c27c49b7734 tempest-SnapshotMetadataTestJSON-2045906085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb.info" returned: 0 in 0.396s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:59 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-7da86bbf-fbb4-40c2-8298-8c27c49b7734 tempest-SnapshotMetadataTestJSON-2045906085 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb.info is being set with open permissions: ugo+rw Nov 03 08:21:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7da86bbf-fbb4-40c2-8298-8c27c49b7734 tempest-SnapshotMetadataTestJSON-2045906085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:59 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb.info Nov 03 08:21:59 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:59 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54 Nov 03 08:21:59 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:21:59 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7da86bbf-fbb4-40c2-8298-8c27c49b7734 tempest-SnapshotMetadataTestJSON-2045906085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb.info" returned: 0 in 0.388s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7da86bbf-fbb4-40c2-8298-8c27c49b7734 tempest-SnapshotMetadataTestJSON-2045906085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.663s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:21:59 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-7da86bbf-fbb4-40c2-8298-8c27c49b7734 tempest-SnapshotMetadataTestJSON-2045906085 None] Create snapshot completed successfully Nov 03 08:21:59 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Nov 03 08:21:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-53dc4ea9-cb10-427f-8865-f88fa49f78d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54" returned: 0 in 0.595s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:21:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-53dc4ea9-cb10-427f-8865-f88fa49f78d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:21:59 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54 Nov 03 08:21:59 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:00 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-53dc4ea9-cb10-427f-8865-f88fa49f78d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-67d60295-e790-4eb1-84bc-12657590fc54" returned: 0 in 0.319s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:00 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-53dc4ea9-cb10-427f-8865-f88fa49f78d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Lock "cinder-quobyte-67d60295-e790-4eb1-84bc-12657590fc54" released by "delete_volume" :: held 1.038s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:22:00 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-53dc4ea9-cb10-427f-8865-f88fa49f78d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Created reservations ['703e22ae-8328-4cef-abdd-0266975cf476', '2921c1d0-266a-446f-bb00-d55cdae7cffd', '24eae4b5-eae0-47d5-83ba-68d451343d04', '5d3007e6-aa86-4d6d-92fc-e00ac80f0624'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:22:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-53dc4ea9-cb10-427f-8865-f88fa49f78d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:22:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-53dc4ea9-cb10-427f-8865-f88fa49f78d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:22:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-53dc4ea9-cb10-427f-8865-f88fa49f78d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:22:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-53dc4ea9-cb10-427f-8865-f88fa49f78d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:22:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-53dc4ea9-cb10-427f-8865-f88fa49f78d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:22:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-53dc4ea9-cb10-427f-8865-f88fa49f78d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:00 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:22:00 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:00 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-53dc4ea9-cb10-427f-8865-f88fa49f78d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.322s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:00 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-53dc4ea9-cb10-427f-8865-f88fa49f78d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:22:00 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-53dc4ea9-cb10-427f-8865-f88fa49f78d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Deleted volume successfully. Nov 03 08:22:00 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-53dc4ea9-cb10-427f-8865-f88fa49f78d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-922479880 None] Lock "cinder-67d60295-e790-4eb1-84bc-12657590fc54-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:22:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6057c5e3-bd90-4dc9-826f-a71051f36375 tempest-SnapshotMetadataTestJSON-2045906085 None] Acquiring lock "cinder-7ca9fe5d-437c-4dc2-a8e5-2f6f618cbde3-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:22:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6057c5e3-bd90-4dc9-826f-a71051f36375 tempest-SnapshotMetadataTestJSON-2045906085 None] Lock "cinder-7ca9fe5d-437c-4dc2-a8e5-2f6f618cbde3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:22:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6057c5e3-bd90-4dc9-826f-a71051f36375 tempest-SnapshotMetadataTestJSON-2045906085 None] Acquiring lock "cinder-quobyte-ff1ebe9c-8653-45d2-aaa3-563240127fbb" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:22:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6057c5e3-bd90-4dc9-826f-a71051f36375 tempest-SnapshotMetadataTestJSON-2045906085 None] Lock "cinder-quobyte-ff1ebe9c-8653-45d2-aaa3-563240127fbb" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:22:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6057c5e3-bd90-4dc9-826f-a71051f36375 tempest-SnapshotMetadataTestJSON-2045906085 None] Acquiring lock "cinder-quobyte-7ca9fe5d-437c-4dc2-a8e5-2f6f618cbde3" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:22:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6057c5e3-bd90-4dc9-826f-a71051f36375 tempest-SnapshotMetadataTestJSON-2045906085 None] Lock "cinder-quobyte-7ca9fe5d-437c-4dc2-a8e5-2f6f618cbde3" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:22:01 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-6057c5e3-bd90-4dc9-826f-a71051f36375 tempest-SnapshotMetadataTestJSON-2045906085 None] Deleting offline snapshot 7ca9fe5d-437c-4dc2-a8e5-2f6f618cbde3 of volume ff1ebe9c-8653-45d2-aaa3-563240127fbb {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:22:01 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-6057c5e3-bd90-4dc9-826f-a71051f36375 tempest-SnapshotMetadataTestJSON-2045906085 None] snapshot_file for this snap is: volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb.7ca9fe5d-437c-4dc2-a8e5-2f6f618cbde3 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:22:01 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[d828fcb0-9412-4748-8e14-676c4cd62df4]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:22:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6057c5e3-bd90-4dc9-826f-a71051f36375 tempest-SnapshotMetadataTestJSON-2045906085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb.7ca9fe5d-437c-4dc2-a8e5-2f6f618cbde3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:01 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb.7ca9fe5d-437c-4dc2-a8e5-2f6f618cbde3 Nov 03 08:22:01 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:02 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6057c5e3-bd90-4dc9-826f-a71051f36375 tempest-SnapshotMetadataTestJSON-2045906085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb.7ca9fe5d-437c-4dc2-a8e5-2f6f618cbde3" returned: 0 in 0.750s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:02 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-6057c5e3-bd90-4dc9-826f-a71051f36375 tempest-SnapshotMetadataTestJSON-2045906085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:22:02 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86453f0-73d6-4c05-a30a-dbfefbd60d63]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:22:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6057c5e3-bd90-4dc9-826f-a71051f36375 tempest-SnapshotMetadataTestJSON-2045906085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:02 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb Nov 03 08:22:02 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:02 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6057c5e3-bd90-4dc9-826f-a71051f36375 tempest-SnapshotMetadataTestJSON-2045906085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb" returned: 0 in 0.537s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6057c5e3-bd90-4dc9-826f-a71051f36375 tempest-SnapshotMetadataTestJSON-2045906085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb.7ca9fe5d-437c-4dc2-a8e5-2f6f618cbde3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:03 devstack sudo[96264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb.7ca9fe5d-437c-4dc2-a8e5-2f6f618cbde3 Nov 03 08:22:03 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:03 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6057c5e3-bd90-4dc9-826f-a71051f36375 tempest-SnapshotMetadataTestJSON-2045906085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb.7ca9fe5d-437c-4dc2-a8e5-2f6f618cbde3" returned: 0 in 0.583s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6057c5e3-bd90-4dc9-826f-a71051f36375 tempest-SnapshotMetadataTestJSON-2045906085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb.7ca9fe5d-437c-4dc2-a8e5-2f6f618cbde3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:03 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb.7ca9fe5d-437c-4dc2-a8e5-2f6f618cbde3 Nov 03 08:22:03 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:03 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:22:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:22:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:22:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:22:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:22:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:22:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:03 devstack sudo[96313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:22:03 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:04 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.390s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:04 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:22:04 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6057c5e3-bd90-4dc9-826f-a71051f36375 tempest-SnapshotMetadataTestJSON-2045906085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb.7ca9fe5d-437c-4dc2-a8e5-2f6f618cbde3" returned: 0 in 0.547s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:04 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager._thread_info {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:22:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread count: 29 {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 08:22:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread info: [<_MainThread(MainThread, started 139707544170624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 08:22:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6057c5e3-bd90-4dc9-826f-a71051f36375 tempest-SnapshotMetadataTestJSON-2045906085 None] Lock "cinder-quobyte-7ca9fe5d-437c-4dc2-a8e5-2f6f618cbde3" released by "_delete_snapshot" :: held 2.604s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:22:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6057c5e3-bd90-4dc9-826f-a71051f36375 tempest-SnapshotMetadataTestJSON-2045906085 None] Lock "cinder-quobyte-ff1ebe9c-8653-45d2-aaa3-563240127fbb" released by "delete_snapshot" :: held 2.645s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:22:04 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-6057c5e3-bd90-4dc9-826f-a71051f36375 tempest-SnapshotMetadataTestJSON-2045906085 None] Created reservations ['0a547787-e475-46f4-832d-9f69c777e228', 'a3c65708-32ac-4711-b0c1-b7a4c12515da', '0bc64ba1-7063-488d-ba21-d67420f723bc', '489eb820-9d7f-482b-8d29-c8393f84a642'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:22:04 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-6057c5e3-bd90-4dc9-826f-a71051f36375 tempest-SnapshotMetadataTestJSON-2045906085 None] Delete snapshot completed successfully. Nov 03 08:22:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6057c5e3-bd90-4dc9-826f-a71051f36375 tempest-SnapshotMetadataTestJSON-2045906085 None] Lock "cinder-7ca9fe5d-437c-4dc2-a8e5-2f6f618cbde3-delete_snapshot" released by "delete_snapshot" :: held 3.040s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:22:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-3b355234-de0f-4e22-9103-f0cdb5bebf32 tempest-SnapshotMetadataTestJSON-2045906085 None] Acquiring lock "cinder-ff1ebe9c-8653-45d2-aaa3-563240127fbb-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:22:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-3b355234-de0f-4e22-9103-f0cdb5bebf32 tempest-SnapshotMetadataTestJSON-2045906085 None] Lock "cinder-ff1ebe9c-8653-45d2-aaa3-563240127fbb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:22:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-3b355234-de0f-4e22-9103-f0cdb5bebf32 tempest-SnapshotMetadataTestJSON-2045906085 None] Acquiring lock "cinder-quobyte-ff1ebe9c-8653-45d2-aaa3-563240127fbb" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:22:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-3b355234-de0f-4e22-9103-f0cdb5bebf32 tempest-SnapshotMetadataTestJSON-2045906085 None] Lock "cinder-quobyte-ff1ebe9c-8653-45d2-aaa3-563240127fbb" acquired by "delete_volume" :: waited 0.018s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:22:05 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09a821e-5029-421b-b6a9-d7520e77dbeb]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:22:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3b355234-de0f-4e22-9103-f0cdb5bebf32 tempest-SnapshotMetadataTestJSON-2045906085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:05 devstack sudo[96340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb Nov 03 08:22:05 devstack sudo[96340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:05 devstack sudo[96340]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3b355234-de0f-4e22-9103-f0cdb5bebf32 tempest-SnapshotMetadataTestJSON-2045906085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb" returned: 0 in 0.682s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3b355234-de0f-4e22-9103-f0cdb5bebf32 tempest-SnapshotMetadataTestJSON-2045906085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:05 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb Nov 03 08:22:05 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:06 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3b355234-de0f-4e22-9103-f0cdb5bebf32 tempest-SnapshotMetadataTestJSON-2045906085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ff1ebe9c-8653-45d2-aaa3-563240127fbb" returned: 0 in 0.742s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:06 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-3b355234-de0f-4e22-9103-f0cdb5bebf32 tempest-SnapshotMetadataTestJSON-2045906085 None] Lock "cinder-quobyte-ff1ebe9c-8653-45d2-aaa3-563240127fbb" released by "delete_volume" :: held 1.530s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:22:06 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-3b355234-de0f-4e22-9103-f0cdb5bebf32 tempest-SnapshotMetadataTestJSON-2045906085 None] Created reservations ['07a92610-3886-4fba-99f3-818887cb5906', 'db8a92d0-df44-41f6-bc83-89047b760a63', 'd8b3bd9f-05d3-4c34-8885-fe72b80c81c5', '9272b6fe-7442-4f39-a6f7-d543774e2be2'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:22:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3b355234-de0f-4e22-9103-f0cdb5bebf32 tempest-SnapshotMetadataTestJSON-2045906085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:22:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3b355234-de0f-4e22-9103-f0cdb5bebf32 tempest-SnapshotMetadataTestJSON-2045906085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:22:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-3b355234-de0f-4e22-9103-f0cdb5bebf32 tempest-SnapshotMetadataTestJSON-2045906085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:22:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-3b355234-de0f-4e22-9103-f0cdb5bebf32 tempest-SnapshotMetadataTestJSON-2045906085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:22:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3b355234-de0f-4e22-9103-f0cdb5bebf32 tempest-SnapshotMetadataTestJSON-2045906085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:22:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3b355234-de0f-4e22-9103-f0cdb5bebf32 tempest-SnapshotMetadataTestJSON-2045906085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:06 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:22:06 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:07 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3b355234-de0f-4e22-9103-f0cdb5bebf32 tempest-SnapshotMetadataTestJSON-2045906085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.303s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:07 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-3b355234-de0f-4e22-9103-f0cdb5bebf32 tempest-SnapshotMetadataTestJSON-2045906085 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:22:07 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-3b355234-de0f-4e22-9103-f0cdb5bebf32 tempest-SnapshotMetadataTestJSON-2045906085 None] Deleted volume successfully. Nov 03 08:22:07 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-3b355234-de0f-4e22-9103-f0cdb5bebf32 tempest-SnapshotMetadataTestJSON-2045906085 None] Lock "cinder-ff1ebe9c-8653-45d2-aaa3-563240127fbb-delete_volume" released by "delete_volume" :: held 2.327s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:22:11 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:22:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Flow 'volume_create_manager' (7533fe47-f672-40f5-ba4c-8abe703a7086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:22:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d957e3e9-d7cd-49f8-b552-8f1c68cb6abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d957e3e9-d7cd-49f8-b552-8f1c68cb6abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2004703475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d71f256c-605c-4f0a-beb5-97b55b5acc14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d22fc54c7ce436fb7bee11f313fd8cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:22:11Z,use_quota=True,user_id='33ec1c5cee634fbcb8bf32de20a8d52c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a9bfb43-7ffd-47b4-86bb-0790d8171f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a9bfb43-7ffd-47b4-86bb-0790d8171f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a42570a-29b3-49e0-b081-b2506a80df29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a42570a-29b3-49e0-b081-b2506a80df29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd71f256c-605c-4f0a-beb5-97b55b5acc14', 'volume_name': 'volume-d71f256c-605c-4f0a-beb5-97b55b5acc14', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18106abe-6fa7-48c3-a87d-0bd50492904a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18106abe-6fa7-48c3-a87d-0bd50492904a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bbee91a-569c-4ffc-a59b-51422d2da612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:11 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Volume d71f256c-605c-4f0a-beb5-97b55b5acc14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d71f256c-605c-4f0a-beb5-97b55b5acc14', 'volume_size': 1} Nov 03 08:22:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:22:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:22:11 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2004703475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d71f256c-605c-4f0a-beb5-97b55b5acc14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d22fc54c7ce436fb7bee11f313fd8cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:22:11Z,use_quota=True,user_id='33ec1c5cee634fbcb8bf32de20a8d52c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:22:11 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Creating volume d71f256c-605c-4f0a-beb5-97b55b5acc14 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:22:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:22:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:22:11 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:22:11 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:22:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:22:11 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:22:11 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:22:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d71f256c-605c-4f0a-beb5-97b55b5acc14 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:11 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d71f256c-605c-4f0a-beb5-97b55b5acc14 1073741824 Nov 03 08:22:11 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:12 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d71f256c-605c-4f0a-beb5-97b55b5acc14 1073741824" returned: 0 in 0.568s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d71f256c-605c-4f0a-beb5-97b55b5acc14 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:12 devstack sudo[96427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d71f256c-605c-4f0a-beb5-97b55b5acc14 Nov 03 08:22:12 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:12 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d71f256c-605c-4f0a-beb5-97b55b5acc14" returned: 0 in 0.379s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:12 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:22:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:22:12 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bbee91a-569c-4ffc-a59b-51422d2da612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d71f256c-605c-4f0a-beb5-97b55b5acc14', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:12 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a7f65d9-01ac-4ff1-8482-ebce3ffc0f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:12 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Volume volume-d71f256c-605c-4f0a-beb5-97b55b5acc14 (d71f256c-605c-4f0a-beb5-97b55b5acc14): created successfully Nov 03 08:22:12 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a7f65d9-01ac-4ff1-8482-ebce3ffc0f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:12 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Flow 'volume_create_manager' (7533fe47-f672-40f5-ba4c-8abe703a7086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:22:12 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-c259d811-149e-43ee-a806-0a77663c9e5b tempest-TestMinimumBasicScenario-226366604 None] Created volume successfully. Nov 03 08:22:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-a2b78a94-ea83-4897-a247-e3ac75becd9d req-5e73e16f-8420-4d8d-bdc3-ae18b2d8eb8e tempest-TestMinimumBasicScenario-226366604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:22:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-a2b78a94-ea83-4897-a247-e3ac75becd9d req-5e73e16f-8420-4d8d-bdc3-ae18b2d8eb8e tempest-TestMinimumBasicScenario-226366604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:22:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-a2b78a94-ea83-4897-a247-e3ac75becd9d req-5e73e16f-8420-4d8d-bdc3-ae18b2d8eb8e tempest-TestMinimumBasicScenario-226366604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:22:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-a2b78a94-ea83-4897-a247-e3ac75becd9d req-5e73e16f-8420-4d8d-bdc3-ae18b2d8eb8e tempest-TestMinimumBasicScenario-226366604 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f', 'name': 'volume-d71f256c-605c-4f0a-beb5-97b55b5acc14', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a11cd6e4-75b4-4a79-b960-2fa4bdffb1b7', 'enforce_multipath': True} {{(pid=86801) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 08:22:15 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-a2b78a94-ea83-4897-a247-e3ac75becd9d req-5e73e16f-8420-4d8d-bdc3-ae18b2d8eb8e tempest-TestMinimumBasicScenario-226366604 None] attachment_update completed successfully. Nov 03 08:22:17 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:22:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Flow 'volume_create_manager' (62335959-27e8-47ce-95a0-d76455ab82d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:22:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7ccd1a-3afa-49cb-810a-2249bb866964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7ccd1a-3afa-49cb-810a-2249bb866964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-290921186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b41e42c-8476-4001-87e3-36ffd3539ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad3e0a48afc14530bf21e51fbf204f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:22:18Z,use_quota=True,user_id='988163fd408e4e5da277a26e66b25e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e44075b-5bcb-4cff-b397-568664f6d153),volume_type_id=3e44075b-5bcb-4cff-b397-568664f6d153)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64fa4d8f-c991-4525-bf44-11a82ec1c9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64fa4d8f-c991-4525-bf44-11a82ec1c9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4611ae22-2521-4ba4-93d4-6ff092e64db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4611ae22-2521-4ba4-93d4-6ff092e64db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b41e42c-8476-4001-87e3-36ffd3539ee3', 'volume_name': 'volume-3b41e42c-8476-4001-87e3-36ffd3539ee3', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ee2900-75e8-4667-9829-4a52bedc1ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ee2900-75e8-4667-9829-4a52bedc1ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0410bbe-248c-45a8-89cd-0d2ae582f262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:17 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Volume 3b41e42c-8476-4001-87e3-36ffd3539ee3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b41e42c-8476-4001-87e3-36ffd3539ee3', 'volume_size': 1} Nov 03 08:22:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:22:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:22:17 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-290921186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b41e42c-8476-4001-87e3-36ffd3539ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad3e0a48afc14530bf21e51fbf204f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:22:18Z,use_quota=True,user_id='988163fd408e4e5da277a26e66b25e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e44075b-5bcb-4cff-b397-568664f6d153),volume_type_id=3e44075b-5bcb-4cff-b397-568664f6d153)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:22:17 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Creating volume 3b41e42c-8476-4001-87e3-36ffd3539ee3 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:22:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:22:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:22:17 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:22:17 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:22:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:22:17 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:22:17 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:22:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3b41e42c-8476-4001-87e3-36ffd3539ee3 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:17 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3b41e42c-8476-4001-87e3-36ffd3539ee3 1073741824 Nov 03 08:22:17 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:18 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3b41e42c-8476-4001-87e3-36ffd3539ee3 1073741824" returned: 0 in 0.736s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3b41e42c-8476-4001-87e3-36ffd3539ee3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:18 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3b41e42c-8476-4001-87e3-36ffd3539ee3 Nov 03 08:22:18 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:19 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3b41e42c-8476-4001-87e3-36ffd3539ee3" returned: 0 in 0.390s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:19 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:22:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:22:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0410bbe-248c-45a8-89cd-0d2ae582f262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b41e42c-8476-4001-87e3-36ffd3539ee3', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2036f08f-f3fb-4869-bc68-21034c5bf711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:19 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Volume volume-3b41e42c-8476-4001-87e3-36ffd3539ee3 (3b41e42c-8476-4001-87e3-36ffd3539ee3): created successfully Nov 03 08:22:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2036f08f-f3fb-4869-bc68-21034c5bf711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Flow 'volume_create_manager' (62335959-27e8-47ce-95a0-d76455ab82d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:22:19 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-38c1d346-c8d4-49d5-8e15-4d983bf80503 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Created volume successfully. Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-78dedf62-d681-4479-add5-a927a4cf33ec tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-78dedf62-d681-4479-add5-a927a4cf33ec tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-78dedf62-d681-4479-add5-a927a4cf33ec tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-78dedf62-d681-4479-add5-a927a4cf33ec tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-78dedf62-d681-4479-add5-a927a4cf33ec tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-78dedf62-d681-4479-add5-a927a4cf33ec tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:20 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:22:20 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Flow 'volume_create_manager' (6d645647-9036-4307-a28e-fa9fc74f7202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d1cccb-2d78-49e7-89b0-ec690849f7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d1cccb-2d78-49e7-89b0-ec690849f7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1385753059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09e6f3f6-eca3-4f07-90dc-7b661c991bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239dfc1b2dd4404b9fd8ac35658a2e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:22:21Z,use_quota=True,user_id='29000ce09b5c4f598cc0e5ca471143d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b6be46-a74a-48db-ae1d-a8b642390f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b6be46-a74a-48db-ae1d-a8b642390f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0ad138f-9151-4bf5-8686-91107ed31513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0ad138f-9151-4bf5-8686-91107ed31513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09e6f3f6-eca3-4f07-90dc-7b661c991bb7', 'volume_name': 'volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22d3448-c22c-42e5-b38f-3e9f9750cb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22d3448-c22c-42e5-b38f-3e9f9750cb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a8d56be-7c26-43e8-8236-53bdc31cbfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:20 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Volume 09e6f3f6-eca3-4f07-90dc-7b661c991bb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7', 'volume_size': 1} Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1385753059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09e6f3f6-eca3-4f07-90dc-7b661c991bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239dfc1b2dd4404b9fd8ac35658a2e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:22:21Z,use_quota=True,user_id='29000ce09b5c4f598cc0e5ca471143d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Creating volume 09e6f3f6-eca3-4f07-90dc-7b661c991bb7 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:22:20 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:20 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-78dedf62-d681-4479-add5-a927a4cf33ec tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.319s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:20 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-78dedf62-d681-4479-add5-a927a4cf33ec tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:22:20 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-78dedf62-d681-4479-add5-a927a4cf33ec tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Retype volume completed successfully. Nov 03 08:22:20 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7 1073741824 Nov 03 08:22:20 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:21 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7 1073741824" returned: 0 in 0.594s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:21 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7 Nov 03 08:22:21 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:21 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7" returned: 0 in 0.312s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:21 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:22:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:22:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a8d56be-7c26-43e8-8236-53bdc31cbfd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c638b8f-a200-4427-9f80-91d2ba711b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:21 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b9cb0a8e-30f0-45a6-8370-8ba998d67468 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Acquiring lock "cinder-3b41e42c-8476-4001-87e3-36ffd3539ee3-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:22:21 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Volume volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7 (09e6f3f6-eca3-4f07-90dc-7b661c991bb7): created successfully Nov 03 08:22:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c638b8f-a200-4427-9f80-91d2ba711b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Flow 'volume_create_manager' (6d645647-9036-4307-a28e-fa9fc74f7202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:22:21 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b9cb0a8e-30f0-45a6-8370-8ba998d67468 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Lock "cinder-3b41e42c-8476-4001-87e3-36ffd3539ee3-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:22:22 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-e90bff1e-bbfe-4c78-863f-11b1677f0a9d tempest-VolumesDeleteCascade-1810668529 None] Created volume successfully. Nov 03 08:22:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b9cb0a8e-30f0-45a6-8370-8ba998d67468 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Acquiring lock "cinder-quobyte-3b41e42c-8476-4001-87e3-36ffd3539ee3" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:22:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b9cb0a8e-30f0-45a6-8370-8ba998d67468 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Lock "cinder-quobyte-3b41e42c-8476-4001-87e3-36ffd3539ee3" acquired by "delete_volume" :: waited 0.020s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:22:22 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[df68243d-b293-4d34-8918-d7284bac4d8e]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:22:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b9cb0a8e-30f0-45a6-8370-8ba998d67468 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3b41e42c-8476-4001-87e3-36ffd3539ee3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:22 devstack sudo[96904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3b41e42c-8476-4001-87e3-36ffd3539ee3 Nov 03 08:22:22 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:22 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b9cb0a8e-30f0-45a6-8370-8ba998d67468 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3b41e42c-8476-4001-87e3-36ffd3539ee3" returned: 0 in 0.422s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b9cb0a8e-30f0-45a6-8370-8ba998d67468 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3b41e42c-8476-4001-87e3-36ffd3539ee3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:22 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3b41e42c-8476-4001-87e3-36ffd3539ee3 Nov 03 08:22:22 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:22 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b9cb0a8e-30f0-45a6-8370-8ba998d67468 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3b41e42c-8476-4001-87e3-36ffd3539ee3" returned: 0 in 0.351s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b9cb0a8e-30f0-45a6-8370-8ba998d67468 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Lock "cinder-quobyte-3b41e42c-8476-4001-87e3-36ffd3539ee3" released by "delete_volume" :: held 0.853s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:22:22 devstack cinder-volume[86801]: WARNING cinder.quota [None req-b9cb0a8e-30f0-45a6-8370-8ba998d67468 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:22:22 devstack cinder-volume[86801]: WARNING cinder.quota [None req-b9cb0a8e-30f0-45a6-8370-8ba998d67468 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:22:23 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-b9cb0a8e-30f0-45a6-8370-8ba998d67468 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Created reservations ['507e82f4-8b13-4d57-a6be-f0b347d7ebcd', 'e4369551-d11c-4cd6-bf4f-24da9b5e087f', '6eeb56be-a908-42a8-8fec-ceaf064470f0', '9c8acd1b-b275-4887-9032-d655ceb7f5f9'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:22:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b9cb0a8e-30f0-45a6-8370-8ba998d67468 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:22:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b9cb0a8e-30f0-45a6-8370-8ba998d67468 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:22:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b9cb0a8e-30f0-45a6-8370-8ba998d67468 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:22:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b9cb0a8e-30f0-45a6-8370-8ba998d67468 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:22:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b9cb0a8e-30f0-45a6-8370-8ba998d67468 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:22:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b9cb0a8e-30f0-45a6-8370-8ba998d67468 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:23 devstack sudo[96913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:22:23 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-eaf2302d-5658-4916-9618-9773b6d2e1c4 tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:22:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-eaf2302d-5658-4916-9618-9773b6d2e1c4 tempest-VolumesDeleteCascade-1810668529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:22:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-eaf2302d-5658-4916-9618-9773b6d2e1c4 tempest-VolumesDeleteCascade-1810668529 None] Creating offline snapshot 81adb386-b0fe-4f30-86b4-b736b21ff164 of volume 09e6f3f6-eca3-4f07-90dc-7b661c991bb7 {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:22:23 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b49ac7b-8621-49ff-8a87-1ffb9437a340]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:22:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eaf2302d-5658-4916-9618-9773b6d2e1c4 tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:23 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b9cb0a8e-30f0-45a6-8370-8ba998d67468 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.498s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:23 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-b9cb0a8e-30f0-45a6-8370-8ba998d67468 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:22:23 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-b9cb0a8e-30f0-45a6-8370-8ba998d67468 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Deleted volume successfully. Nov 03 08:22:23 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b9cb0a8e-30f0-45a6-8370-8ba998d67468 tempest-VolumeRetypeWithoutMigrationTest-1507203075 None] Lock "cinder-3b41e42c-8476-4001-87e3-36ffd3539ee3-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:22:23 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7 Nov 03 08:22:23 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:24 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eaf2302d-5658-4916-9618-9773b6d2e1c4 tempest-VolumesDeleteCascade-1810668529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7" returned: 0 in 0.578s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eaf2302d-5658-4916-9618-9773b6d2e1c4 tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:24 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164 1G Nov 03 08:22:24 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:24 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eaf2302d-5658-4916-9618-9773b6d2e1c4 tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164 1G" returned: 0 in 0.549s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eaf2302d-5658-4916-9618-9773b6d2e1c4 tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:24 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164 Nov 03 08:22:24 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:24 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eaf2302d-5658-4916-9618-9773b6d2e1c4 tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164" returned: 0 in 0.343s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:24 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-eaf2302d-5658-4916-9618-9773b6d2e1c4 tempest-VolumesDeleteCascade-1810668529 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164 is being set with open permissions: ugo+rw Nov 03 08:22:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eaf2302d-5658-4916-9618-9773b6d2e1c4 tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:25 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164 Nov 03 08:22:25 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:25 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eaf2302d-5658-4916-9618-9773b6d2e1c4 tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164" returned: 0 in 0.275s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eaf2302d-5658-4916-9618-9773b6d2e1c4 tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:25 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.info Nov 03 08:22:25 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:25 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eaf2302d-5658-4916-9618-9773b6d2e1c4 tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.info" returned: 0 in 0.414s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:25 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-eaf2302d-5658-4916-9618-9773b6d2e1c4 tempest-VolumesDeleteCascade-1810668529 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.info is being set with open permissions: ugo+rw Nov 03 08:22:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eaf2302d-5658-4916-9618-9773b6d2e1c4 tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:25 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.info Nov 03 08:22:25 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:26 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eaf2302d-5658-4916-9618-9773b6d2e1c4 tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.info" returned: 0 in 0.307s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-eaf2302d-5658-4916-9618-9773b6d2e1c4 tempest-VolumesDeleteCascade-1810668529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.624s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:22:26 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-eaf2302d-5658-4916-9618-9773b6d2e1c4 tempest-VolumesDeleteCascade-1810668529 None] Create snapshot completed successfully Nov 03 08:22:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-578913b9-cb3f-4a26-b9fc-19b34d1b6af0 tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:22:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-578913b9-cb3f-4a26-b9fc-19b34d1b6af0 tempest-VolumesDeleteCascade-1810668529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:22:26 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-578913b9-cb3f-4a26-b9fc-19b34d1b6af0 tempest-VolumesDeleteCascade-1810668529 None] Creating offline snapshot 63baf63c-15a5-4bf8-a476-52fa6d7c9fdf of volume 09e6f3f6-eca3-4f07-90dc-7b661c991bb7 {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:22:26 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[23530e9d-afa9-419d-9e1e-1acbd388843b]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:22:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-578913b9-cb3f-4a26-b9fc-19b34d1b6af0 tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:27 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164 Nov 03 08:22:27 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:27 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-578913b9-cb3f-4a26-b9fc-19b34d1b6af0 tempest-VolumesDeleteCascade-1810668529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164" returned: 0 in 0.449s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-578913b9-cb3f-4a26-b9fc-19b34d1b6af0 tempest-VolumesDeleteCascade-1810668529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:22:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-578913b9-cb3f-4a26-b9fc-19b34d1b6af0 tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.63baf63c-15a5-4bf8-a476-52fa6d7c9fdf 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:27 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.63baf63c-15a5-4bf8-a476-52fa6d7c9fdf 1G Nov 03 08:22:27 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:28 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-578913b9-cb3f-4a26-b9fc-19b34d1b6af0 tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.63baf63c-15a5-4bf8-a476-52fa6d7c9fdf 1G" returned: 0 in 0.813s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-578913b9-cb3f-4a26-b9fc-19b34d1b6af0 tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.63baf63c-15a5-4bf8-a476-52fa6d7c9fdf {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:28 devstack sudo[96953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.63baf63c-15a5-4bf8-a476-52fa6d7c9fdf Nov 03 08:22:28 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:28 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-578913b9-cb3f-4a26-b9fc-19b34d1b6af0 tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.63baf63c-15a5-4bf8-a476-52fa6d7c9fdf" returned: 0 in 0.445s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:28 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-578913b9-cb3f-4a26-b9fc-19b34d1b6af0 tempest-VolumesDeleteCascade-1810668529 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.63baf63c-15a5-4bf8-a476-52fa6d7c9fdf is being set with open permissions: ugo+rw Nov 03 08:22:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-578913b9-cb3f-4a26-b9fc-19b34d1b6af0 tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.63baf63c-15a5-4bf8-a476-52fa6d7c9fdf {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:28 devstack sudo[96958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.63baf63c-15a5-4bf8-a476-52fa6d7c9fdf Nov 03 08:22:28 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:29 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-578913b9-cb3f-4a26-b9fc-19b34d1b6af0 tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.63baf63c-15a5-4bf8-a476-52fa6d7c9fdf" returned: 0 in 0.458s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-578913b9-cb3f-4a26-b9fc-19b34d1b6af0 tempest-VolumesDeleteCascade-1810668529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.326s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:22:29 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-578913b9-cb3f-4a26-b9fc-19b34d1b6af0 tempest-VolumesDeleteCascade-1810668529 None] Create snapshot completed successfully Nov 03 08:22:30 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "cinder-09e6f3f6-eca3-4f07-90dc-7b661c991bb7-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:22:30 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-09e6f3f6-eca3-4f07-90dc-7b661c991bb7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:22:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Performing cascade delete. {{(pid=86801) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 03 08:22:30 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "cinder-63baf63c-15a5-4bf8-a476-52fa6d7c9fdf-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:22:30 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-63baf63c-15a5-4bf8-a476-52fa6d7c9fdf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:22:30 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "cinder-quobyte-09e6f3f6-eca3-4f07-90dc-7b661c991bb7" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:22:30 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-quobyte-09e6f3f6-eca3-4f07-90dc-7b661c991bb7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:22:30 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "cinder-quobyte-63baf63c-15a5-4bf8-a476-52fa6d7c9fdf" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:22:30 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-quobyte-63baf63c-15a5-4bf8-a476-52fa6d7c9fdf" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:22:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Deleting offline snapshot 63baf63c-15a5-4bf8-a476-52fa6d7c9fdf of volume 09e6f3f6-eca3-4f07-90dc-7b661c991bb7 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:22:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] snapshot_file for this snap is: volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.63baf63c-15a5-4bf8-a476-52fa6d7c9fdf {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:22:30 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf11559-11a0-4c67-90eb-385d039b82af]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:22:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.63baf63c-15a5-4bf8-a476-52fa6d7c9fdf {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:30 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.63baf63c-15a5-4bf8-a476-52fa6d7c9fdf Nov 03 08:22:30 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:31 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.63baf63c-15a5-4bf8-a476-52fa6d7c9fdf" returned: 0 in 0.725s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:22:31 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e651c59-beb4-4fe7-98eb-cf2d288f1cd8]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:22:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:31 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164 Nov 03 08:22:31 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:31 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164" returned: 0 in 0.675s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:22:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.63baf63c-15a5-4bf8-a476-52fa6d7c9fdf {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:31 devstack sudo[96973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.63baf63c-15a5-4bf8-a476-52fa6d7c9fdf Nov 03 08:22:31 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:32 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.63baf63c-15a5-4bf8-a476-52fa6d7c9fdf" returned: 0 in 0.536s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.63baf63c-15a5-4bf8-a476-52fa6d7c9fdf {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:32 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.63baf63c-15a5-4bf8-a476-52fa6d7c9fdf Nov 03 08:22:32 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:32 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.63baf63c-15a5-4bf8-a476-52fa6d7c9fdf" returned: 0 in 0.398s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:32 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-quobyte-63baf63c-15a5-4bf8-a476-52fa6d7c9fdf" released by "_delete_snapshot" :: held 2.512s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:22:32 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-quobyte-09e6f3f6-eca3-4f07-90dc-7b661c991bb7" released by "delete_snapshot" :: held 2.554s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:22:32 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:22:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Flow 'volume_create_manager' (3ef8e2f4-668f-4308-9e93-8c7b7c01ed70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f1b953e-a3ac-4483-a7a1-01ea8ca4d65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f1b953e-a3ac-4483-a7a1-01ea8ca4d65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-399699668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b304e7-6ec1-4c97-b0ae-575f53f9f0b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c3e5820eab4f66bd3e9920ab77462d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:22:33Z,use_quota=True,user_id='acdf4b493316407787443cdb965b5396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(167fa7bd-d8ae-4bf8-a867-a140eae08d53),volume_type_id=167fa7bd-d8ae-4bf8-a867-a140eae08d53)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c35551ac-8f03-4e99-ae03-6b4dbec09a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c35551ac-8f03-4e99-ae03-6b4dbec09a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (430c0a27-40b2-459e-bed2-7480d4f332df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (430c0a27-40b2-459e-bed2-7480d4f332df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4b304e7-6ec1-4c97-b0ae-575f53f9f0b5', 'volume_name': 'volume-e4b304e7-6ec1-4c97-b0ae-575f53f9f0b5', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099e6d56-e9c8-4614-a661-80d7bf0ef558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099e6d56-e9c8-4614-a661-80d7bf0ef558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a08786f5-32bf-4401-a3d4-152cc980bb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:33 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Volume e4b304e7-6ec1-4c97-b0ae-575f53f9f0b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4b304e7-6ec1-4c97-b0ae-575f53f9f0b5', 'volume_size': 1} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-399699668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b304e7-6ec1-4c97-b0ae-575f53f9f0b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c3e5820eab4f66bd3e9920ab77462d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:22:33Z,use_quota=True,user_id='acdf4b493316407787443cdb965b5396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(167fa7bd-d8ae-4bf8-a867-a140eae08d53),volume_type_id=167fa7bd-d8ae-4bf8-a867-a140eae08d53)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Creating volume e4b304e7-6ec1-4c97-b0ae-575f53f9f0b5 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:22:33 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e4b304e7-6ec1-4c97-b0ae-575f53f9f0b5 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Created reservations ['36f6fd0d-eb65-4e96-904b-3b46a2158628', '0a19c18b-1341-4c8e-a9d8-e576577c5541', '17a2dc12-378f-4734-bf89-28e61e577772', '9b696b53-404e-46b4-966b-ed50abf0440c'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:22:33 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e4b304e7-6ec1-4c97-b0ae-575f53f9f0b5 1073741824 Nov 03 08:22:33 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:33 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Delete snapshot completed successfully. Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-63baf63c-15a5-4bf8-a476-52fa6d7c9fdf-delete_snapshot" released by "delete_snapshot" :: held 2.903s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "cinder-81adb386-b0fe-4f30-86b4-b736b21ff164-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-81adb386-b0fe-4f30-86b4-b736b21ff164-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "cinder-quobyte-09e6f3f6-eca3-4f07-90dc-7b661c991bb7" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-quobyte-09e6f3f6-eca3-4f07-90dc-7b661c991bb7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "cinder-quobyte-81adb386-b0fe-4f30-86b4-b736b21ff164" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-quobyte-81adb386-b0fe-4f30-86b4-b736b21ff164" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Deleting offline snapshot 81adb386-b0fe-4f30-86b4-b736b21ff164 of volume 09e6f3f6-eca3-4f07-90dc-7b661c991bb7 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] snapshot_file for this snap is: volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[c799f5f9-069b-4572-8fb0-a7b3f6cf5218]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:33 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164 Nov 03 08:22:33 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:33 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e4b304e7-6ec1-4c97-b0ae-575f53f9f0b5 1073741824" returned: 0 in 0.591s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e4b304e7-6ec1-4c97-b0ae-575f53f9f0b5 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:33 devstack sudo[96990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e4b304e7-6ec1-4c97-b0ae-575f53f9f0b5 Nov 03 08:22:33 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:33 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164" returned: 0 in 0.522s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab85538-6292-423f-90e6-a7a7e8421a54]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:22:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:34 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e4b304e7-6ec1-4c97-b0ae-575f53f9f0b5" returned: 0 in 0.360s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:34 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:22:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:22:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a08786f5-32bf-4401-a3d4-152cc980bb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4b304e7-6ec1-4c97-b0ae-575f53f9f0b5', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef39cf0a-3d1e-4de7-bb6c-646472da12f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:34 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Volume volume-e4b304e7-6ec1-4c97-b0ae-575f53f9f0b5 (e4b304e7-6ec1-4c97-b0ae-575f53f9f0b5): created successfully Nov 03 08:22:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef39cf0a-3d1e-4de7-bb6c-646472da12f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:34 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7 Nov 03 08:22:34 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Flow 'volume_create_manager' (3ef8e2f4-668f-4308-9e93-8c7b7c01ed70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:22:34 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-21ab7a7d-9d1b-449f-8be3-989a2c48dd87 tempest-VolumeTypesAccessTest-695155236 None] Created volume successfully. Nov 03 08:22:34 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7" returned: 0 in 0.472s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:34 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164 Nov 03 08:22:34 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164" returned: 0 in 0.531s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:34 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:35 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164 Nov 03 08:22:35 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9bfe5b17-e394-492f-af48-80ff6f6144fc tempest-VolumeTypesAccessTest-695155236 None] Acquiring lock "cinder-e4b304e7-6ec1-4c97-b0ae-575f53f9f0b5-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:22:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9bfe5b17-e394-492f-af48-80ff6f6144fc tempest-VolumeTypesAccessTest-695155236 None] Lock "cinder-e4b304e7-6ec1-4c97-b0ae-575f53f9f0b5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:22:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9bfe5b17-e394-492f-af48-80ff6f6144fc tempest-VolumeTypesAccessTest-695155236 None] Acquiring lock "cinder-quobyte-e4b304e7-6ec1-4c97-b0ae-575f53f9f0b5" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:22:35 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9bfe5b17-e394-492f-af48-80ff6f6144fc tempest-VolumeTypesAccessTest-695155236 None] Lock "cinder-quobyte-e4b304e7-6ec1-4c97-b0ae-575f53f9f0b5" acquired by "delete_volume" :: waited 0.020s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:22:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7.81adb386-b0fe-4f30-86b4-b736b21ff164" returned: 0 in 0.421s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:35 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3957ac8-c5cb-42f0-9b3d-b846262ffe8a]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:22:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9bfe5b17-e394-492f-af48-80ff6f6144fc tempest-VolumeTypesAccessTest-695155236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e4b304e7-6ec1-4c97-b0ae-575f53f9f0b5 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-quobyte-81adb386-b0fe-4f30-86b4-b736b21ff164" released by "_delete_snapshot" :: held 2.122s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:22:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-quobyte-09e6f3f6-eca3-4f07-90dc-7b661c991bb7" released by "delete_snapshot" :: held 2.152s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:22:35 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Created reservations ['ecf13761-bd16-4917-a450-3e8fdbbb346d', 'ae0b072c-38ca-4fa8-aac6-4f23af788699', '3c7fbbab-f261-4e7a-ba0d-7162308a373a', 'd45516f0-0cad-411a-a934-344557e7fdd8'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:22:35 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e4b304e7-6ec1-4c97-b0ae-575f53f9f0b5 Nov 03 08:22:35 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:35 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Delete snapshot completed successfully. Nov 03 08:22:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-81adb386-b0fe-4f30-86b4-b736b21ff164-delete_snapshot" released by "delete_snapshot" :: held 2.360s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:22:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Snapshots deleted, issuing volume delete {{(pid=86801) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 03 08:22:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "cinder-quobyte-09e6f3f6-eca3-4f07-90dc-7b661c991bb7" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:22:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-quobyte-09e6f3f6-eca3-4f07-90dc-7b661c991bb7" acquired by "delete_volume" :: waited 0.015s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:22:35 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b858b9e-f90f-46f3-a3c4-d97443390dd4]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:22:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:35 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7 Nov 03 08:22:35 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:35 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9bfe5b17-e394-492f-af48-80ff6f6144fc tempest-VolumeTypesAccessTest-695155236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e4b304e7-6ec1-4c97-b0ae-575f53f9f0b5" returned: 0 in 0.526s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9bfe5b17-e394-492f-af48-80ff6f6144fc tempest-VolumeTypesAccessTest-695155236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e4b304e7-6ec1-4c97-b0ae-575f53f9f0b5 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:35 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e4b304e7-6ec1-4c97-b0ae-575f53f9f0b5 Nov 03 08:22:35 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:36 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7" returned: 0 in 0.414s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:36 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7 Nov 03 08:22:36 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:36 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9bfe5b17-e394-492f-af48-80ff6f6144fc tempest-VolumeTypesAccessTest-695155236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e4b304e7-6ec1-4c97-b0ae-575f53f9f0b5" returned: 0 in 0.322s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9bfe5b17-e394-492f-af48-80ff6f6144fc tempest-VolumeTypesAccessTest-695155236 None] Lock "cinder-quobyte-e4b304e7-6ec1-4c97-b0ae-575f53f9f0b5" released by "delete_volume" :: held 0.919s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:22:36 devstack cinder-volume[86801]: WARNING cinder.quota [None req-9bfe5b17-e394-492f-af48-80ff6f6144fc tempest-VolumeTypesAccessTest-695155236 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1837381750 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1837381750, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:22:36 devstack cinder-volume[86801]: WARNING cinder.quota [None req-9bfe5b17-e394-492f-af48-80ff6f6144fc tempest-VolumeTypesAccessTest-695155236 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1837381750 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1837381750, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:22:36 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-9bfe5b17-e394-492f-af48-80ff6f6144fc tempest-VolumeTypesAccessTest-695155236 None] Created reservations ['becc6bb2-4f5e-4367-97a1-b6780eab6105', 'af117f6a-c45f-4748-adb4-5eab2ca9504b', '924f4784-c882-4cda-bf25-8bb86503a065', '6f62375d-8498-4279-8903-5f1338076c71'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:22:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9bfe5b17-e394-492f-af48-80ff6f6144fc tempest-VolumeTypesAccessTest-695155236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:22:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9bfe5b17-e394-492f-af48-80ff6f6144fc tempest-VolumeTypesAccessTest-695155236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:22:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9bfe5b17-e394-492f-af48-80ff6f6144fc tempest-VolumeTypesAccessTest-695155236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:22:36 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9bfe5b17-e394-492f-af48-80ff6f6144fc tempest-VolumeTypesAccessTest-695155236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:22:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9bfe5b17-e394-492f-af48-80ff6f6144fc tempest-VolumeTypesAccessTest-695155236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:22:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9bfe5b17-e394-492f-af48-80ff6f6144fc tempest-VolumeTypesAccessTest-695155236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09e6f3f6-eca3-4f07-90dc-7b661c991bb7" returned: 0 in 0.322s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-quobyte-09e6f3f6-eca3-4f07-90dc-7b661c991bb7" released by "delete_volume" :: held 0.848s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:22:36 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:22:36 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:36 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Created reservations ['c6448a95-ec68-409e-b7f3-836fd999c50b', '7d744948-91ad-4eac-8efe-69f59b1cd203', '066d6b8b-8572-44f2-9c32-cf8a849d706a', '00410a36-423c-4250-8671-19bc7caac8ee'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:22:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:22:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:22:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:22:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:22:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:22:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:36 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:22:36 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:36 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9bfe5b17-e394-492f-af48-80ff6f6144fc tempest-VolumeTypesAccessTest-695155236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.303s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:36 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-9bfe5b17-e394-492f-af48-80ff6f6144fc tempest-VolumeTypesAccessTest-695155236 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:22:36 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-9bfe5b17-e394-492f-af48-80ff6f6144fc tempest-VolumeTypesAccessTest-695155236 None] Deleted volume successfully. Nov 03 08:22:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9bfe5b17-e394-492f-af48-80ff6f6144fc tempest-VolumeTypesAccessTest-695155236 None] Lock "cinder-e4b304e7-6ec1-4c97-b0ae-575f53f9f0b5-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:22:36 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.325s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:36 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:22:36 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Deleted volume successfully. Nov 03 08:22:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6cd0f185-a30b-4a36-a714-181955f7d19d tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-09e6f3f6-eca3-4f07-90dc-7b661c991bb7-delete_volume" released by "delete_volume" :: held 6.763s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:22:38 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:22:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Flow 'volume_create_manager' (ba2a01dc-f456-490d-a06a-e8d4d8361984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:22:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5098f55-8129-42c1-a0bf-b0de691916dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5098f55-8129-42c1-a0bf-b0de691916dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-44069682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c989f7d-8c7c-42d5-9a1b-e1f3f226729b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239dfc1b2dd4404b9fd8ac35658a2e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:22:38Z,use_quota=True,user_id='29000ce09b5c4f598cc0e5ca471143d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ae5c31-34e1-4639-be78-c1c29ada8f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ae5c31-34e1-4639-be78-c1c29ada8f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (625cfc51-bba6-454a-b3bc-3c703ec9e80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (625cfc51-bba6-454a-b3bc-3c703ec9e80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c989f7d-8c7c-42d5-9a1b-e1f3f226729b', 'volume_name': 'volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9ae3b9-a9ff-4c41-991d-ad532c21c809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9ae3b9-a9ff-4c41-991d-ad532c21c809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac4a8bb3-ea83-43d1-a9a7-6b8171687c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:38 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Volume 4c989f7d-8c7c-42d5-9a1b-e1f3f226729b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b', 'volume_size': 1} Nov 03 08:22:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:22:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:22:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-44069682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c989f7d-8c7c-42d5-9a1b-e1f3f226729b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239dfc1b2dd4404b9fd8ac35658a2e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:22:38Z,use_quota=True,user_id='29000ce09b5c4f598cc0e5ca471143d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:22:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Creating volume 4c989f7d-8c7c-42d5-9a1b-e1f3f226729b {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:22:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:22:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:22:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:22:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:22:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:22:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:22:38 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:22:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:38 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b 1073741824 Nov 03 08:22:38 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:39 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b 1073741824" returned: 0 in 0.616s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:39 devstack sudo[97092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b Nov 03 08:22:39 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:39 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b" returned: 0 in 0.421s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:39 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:22:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:22:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac4a8bb3-ea83-43d1-a9a7-6b8171687c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9a66ab-dc9e-43d4-ab59-edbba6f22c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:39 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Volume volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b (4c989f7d-8c7c-42d5-9a1b-e1f3f226729b): created successfully Nov 03 08:22:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9a66ab-dc9e-43d4-ab59-edbba6f22c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Flow 'volume_create_manager' (ba2a01dc-f456-490d-a06a-e8d4d8361984) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:22:39 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-05692f68-45c3-473f-aac3-a79e0fd4d272 tempest-VolumesDeleteCascade-1810668529 None] Created volume successfully. Nov 03 08:22:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-86290de7-0f7a-4cf6-9e56-b1a8e3fd54eb tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:22:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-86290de7-0f7a-4cf6-9e56-b1a8e3fd54eb tempest-VolumesDeleteCascade-1810668529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:22:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-86290de7-0f7a-4cf6-9e56-b1a8e3fd54eb tempest-VolumesDeleteCascade-1810668529 None] Creating offline snapshot 11484a90-655b-4bd6-90ee-d39b62d77235 of volume 4c989f7d-8c7c-42d5-9a1b-e1f3f226729b {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:22:40 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f621191-d84c-4d71-8f18-7830764e4417]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:22:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-86290de7-0f7a-4cf6-9e56-b1a8e3fd54eb tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:40 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b Nov 03 08:22:40 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:41 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-86290de7-0f7a-4cf6-9e56-b1a8e3fd54eb tempest-VolumesDeleteCascade-1810668529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b" returned: 0 in 0.589s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-86290de7-0f7a-4cf6-9e56-b1a8e3fd54eb tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.11484a90-655b-4bd6-90ee-d39b62d77235 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:41 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.11484a90-655b-4bd6-90ee-d39b62d77235 1G Nov 03 08:22:41 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:42 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-86290de7-0f7a-4cf6-9e56-b1a8e3fd54eb tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.11484a90-655b-4bd6-90ee-d39b62d77235 1G" returned: 0 in 0.808s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-86290de7-0f7a-4cf6-9e56-b1a8e3fd54eb tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.11484a90-655b-4bd6-90ee-d39b62d77235 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:42 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.11484a90-655b-4bd6-90ee-d39b62d77235 Nov 03 08:22:42 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:42 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-86290de7-0f7a-4cf6-9e56-b1a8e3fd54eb tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.11484a90-655b-4bd6-90ee-d39b62d77235" returned: 0 in 0.474s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:42 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-86290de7-0f7a-4cf6-9e56-b1a8e3fd54eb tempest-VolumesDeleteCascade-1810668529 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.11484a90-655b-4bd6-90ee-d39b62d77235 is being set with open permissions: ugo+rw Nov 03 08:22:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-86290de7-0f7a-4cf6-9e56-b1a8e3fd54eb tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.11484a90-655b-4bd6-90ee-d39b62d77235 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:42 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.11484a90-655b-4bd6-90ee-d39b62d77235 Nov 03 08:22:42 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:42 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-86290de7-0f7a-4cf6-9e56-b1a8e3fd54eb tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.11484a90-655b-4bd6-90ee-d39b62d77235" returned: 0 in 0.359s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-86290de7-0f7a-4cf6-9e56-b1a8e3fd54eb tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:43 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.info Nov 03 08:22:43 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:43 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-86290de7-0f7a-4cf6-9e56-b1a8e3fd54eb tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.info" returned: 0 in 0.410s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:43 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-86290de7-0f7a-4cf6-9e56-b1a8e3fd54eb tempest-VolumesDeleteCascade-1810668529 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.info is being set with open permissions: ugo+rw Nov 03 08:22:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-86290de7-0f7a-4cf6-9e56-b1a8e3fd54eb tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:43 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.info Nov 03 08:22:43 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:43 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-86290de7-0f7a-4cf6-9e56-b1a8e3fd54eb tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.info" returned: 0 in 0.390s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-86290de7-0f7a-4cf6-9e56-b1a8e3fd54eb tempest-VolumesDeleteCascade-1810668529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.188s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:22:43 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-86290de7-0f7a-4cf6-9e56-b1a8e3fd54eb tempest-VolumesDeleteCascade-1810668529 None] Create snapshot completed successfully Nov 03 08:22:45 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:22:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Flow 'volume_create_manager' (b38d8ba4-11d7-4694-a58f-8d4185f4822f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:22:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67378e9a-66fa-491b-b58d-186069f50b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67378e9a-66fa-491b-b58d-186069f50b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1200092447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c520e5a-b697-4327-af77-65249e089012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239dfc1b2dd4404b9fd8ac35658a2e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=11484a90-655b-4bd6-90ee-d39b62d77235,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:22:46Z,use_quota=True,user_id='29000ce09b5c4f598cc0e5ca471143d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be440eba-09e9-4805-b844-963ae461bdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be440eba-09e9-4805-b844-963ae461bdc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ced3c57-0aab-486e-abbc-7021293458d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ced3c57-0aab-486e-abbc-7021293458d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3c520e5a-b697-4327-af77-65249e089012', 'volume_name': 'volume-3c520e5a-b697-4327-af77-65249e089012', 'volume_size': 1, 'snapshot_id': '11484a90-655b-4bd6-90ee-d39b62d77235'}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a30677bb-3b9b-4f77-a582-894d78092b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a30677bb-3b9b-4f77-a582-894d78092b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b7d1e57-353b-43bf-9843-39fec58e6235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:46 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Volume 3c520e5a-b697-4327-af77-65249e089012: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3c520e5a-b697-4327-af77-65249e089012', 'volume_size': 1, 'snapshot_id': '11484a90-655b-4bd6-90ee-d39b62d77235'} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "cinder-quobyte-11484a90-655b-4bd6-90ee-d39b62d77235-3c520e5a-b697-4327-af77-65249e089012" by "_create_volume_from_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-quobyte-11484a90-655b-4bd6-90ee-d39b62d77235-3c520e5a-b697-4327-af77-65249e089012" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Creating volume 3c520e5a-b697-4327-af77-65249e089012 from snapshot 11484a90-655b-4bd6-90ee-d39b62d77235 {{(pid=86801) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "cinder-quobyte-3c520e5a-b697-4327-af77-65249e089012" by "_copy_volume_from_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-quobyte-3c520e5a-b697-4327-af77-65249e089012" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] snapshot: 11484a90-655b-4bd6-90ee-d39b62d77235, volume: 3c520e5a-b697-4327-af77-65249e089012, {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[25200e92-8259-4702-99af-bb552b2a2d4f]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.11484a90-655b-4bd6-90ee-d39b62d77235 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:46 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.11484a90-655b-4bd6-90ee-d39b62d77235 Nov 03 08:22:46 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:46 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.11484a90-655b-4bd6-90ee-d39b62d77235" returned: 0 in 0.597s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[64214a0d-6916-49f1-b962-b38d73d0bd30]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:22:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:47 devstack sudo[97132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b Nov 03 08:22:47 devstack sudo[97132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:47 devstack sudo[97132]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b" returned: 0 in 0.721s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:47 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 08:22:47 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Creating direct copy from snapshot {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 08:22:47 devstack cinder-volume[86801]: DEBUG cinder.utils [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Path /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3c520e5a-b697-4327-af77-65249e089012 not found in is_blk_device check {{(pid=86801) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 08:22:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3c520e5a-b697-4327-af77-65249e089012 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:47 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3c520e5a-b697-4327-af77-65249e089012 Nov 03 08:22:47 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:56 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:UPDATE=82,cinder:SELECT=85,cinder:INSERT=26,cinder:DELETE=9 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:22:57 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3c520e5a-b697-4327-af77-65249e089012" returned: 0 in 10.038s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:57 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b, size 1024.00 MB, duration 10.04 sec, destination /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3c520e5a-b697-4327-af77-65249e089012 {{(pid=86801) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 08:22:57 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Converted 1024.00 MB image at 102.00 MB/s Nov 03 08:22:57 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3c520e5a-b697-4327-af77-65249e089012 is being set with open permissions: ugo+rw Nov 03 08:22:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3c520e5a-b697-4327-af77-65249e089012 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:57 devstack sudo[97177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3c520e5a-b697-4327-af77-65249e089012 Nov 03 08:22:57 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:57 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:DELETE=7,cinder:SELECT=88,cinder:UPDATE=102,cinder:INSERT=19 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:22:57 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3c520e5a-b697-4327-af77-65249e089012" returned: 0 in 0.352s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:57 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-quobyte-3c520e5a-b697-4327-af77-65249e089012" released by "_copy_volume_from_snapshot" :: held 11.838s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:22:58 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-quobyte-11484a90-655b-4bd6-90ee-d39b62d77235-3c520e5a-b697-4327-af77-65249e089012" released by "_create_volume_from_snapshot" :: held 11.938s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:22:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.959s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:22:58 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b7d1e57-353b-43bf-9843-39fec58e6235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c520e5a-b697-4327-af77-65249e089012', 'volume_size': 1, 'snapshot_id': '11484a90-655b-4bd6-90ee-d39b62d77235'}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:58 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0c55a4-3712-4429-8e31-6c167456454f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:22:58 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Volume volume-3c520e5a-b697-4327-af77-65249e089012 (3c520e5a-b697-4327-af77-65249e089012): created successfully Nov 03 08:22:58 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0c55a4-3712-4429-8e31-6c167456454f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:22:58 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Flow 'volume_create_manager' (b38d8ba4-11d7-4694-a58f-8d4185f4822f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:22:58 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-68df6533-8a85-45a2-893c-0d7ebe7f69ba tempest-VolumesDeleteCascade-1810668529 None] Created volume successfully. Nov 03 08:22:58 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "cinder-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:22:58 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:22:58 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Performing cascade delete. {{(pid=86801) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 03 08:22:58 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "cinder-11484a90-655b-4bd6-90ee-d39b62d77235-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:22:58 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-11484a90-655b-4bd6-90ee-d39b62d77235-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:22:58 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "cinder-quobyte-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:22:58 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-quobyte-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:22:58 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "cinder-quobyte-11484a90-655b-4bd6-90ee-d39b62d77235" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:22:58 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-quobyte-11484a90-655b-4bd6-90ee-d39b62d77235" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:22:58 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Deleting offline snapshot 11484a90-655b-4bd6-90ee-d39b62d77235 of volume 4c989f7d-8c7c-42d5-9a1b-e1f3f226729b {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:22:58 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] snapshot_file for this snap is: volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.11484a90-655b-4bd6-90ee-d39b62d77235 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:22:58 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11f46b6-325b-41c2-9465-1aad1badb348]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:22:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.11484a90-655b-4bd6-90ee-d39b62d77235 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:59 devstack sudo[97186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.11484a90-655b-4bd6-90ee-d39b62d77235 Nov 03 08:22:59 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:22:59 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root Nov 03 08:22:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.11484a90-655b-4bd6-90ee-d39b62d77235" returned: 0 in 0.468s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:22:59 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:22:59 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[4963eb08-1a31-40a1-80cf-29827123a91e]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:22:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:22:59 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b Nov 03 08:22:59 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:00 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b" returned: 0 in 0.840s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.11484a90-655b-4bd6-90ee-d39b62d77235 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:00 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.11484a90-655b-4bd6-90ee-d39b62d77235 Nov 03 08:23:00 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:01 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.11484a90-655b-4bd6-90ee-d39b62d77235" returned: 0 in 0.913s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.11484a90-655b-4bd6-90ee-d39b62d77235 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:01 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.11484a90-655b-4bd6-90ee-d39b62d77235 Nov 03 08:23:01 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:01 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b.11484a90-655b-4bd6-90ee-d39b62d77235" returned: 0 in 0.485s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-quobyte-11484a90-655b-4bd6-90ee-d39b62d77235" released by "_delete_snapshot" :: held 2.841s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-quobyte-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b" released by "delete_snapshot" :: held 2.870s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:01 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Created reservations ['894d6132-805e-4e13-924a-617be40dcc35', 'e05f39ab-ce90-464d-afd1-cb27681153d6', '6ae3c124-2fd6-45b2-b2ab-5e2ffc3f54ef', '711c6924-10e7-440e-bf2c-3001fd1d04eb'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:23:01 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Delete snapshot completed successfully. Nov 03 08:23:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-11484a90-655b-4bd6-90ee-d39b62d77235-delete_snapshot" released by "delete_snapshot" :: held 3.118s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:01 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Snapshots deleted, issuing volume delete {{(pid=86801) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 03 08:23:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "cinder-quobyte-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-quobyte-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b" acquired by "delete_volume" :: waited 0.025s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:01 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f28acea-7a70-4299-b695-95df6cd6f35e]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:23:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:02 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b Nov 03 08:23:02 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:02 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b" returned: 0 in 0.674s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:02 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b Nov 03 08:23:02 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:03 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b" returned: 0 in 0.367s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-quobyte-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b" released by "delete_volume" :: held 1.149s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:03 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Created reservations ['65acc4f5-7442-4e84-8cfd-841e40ed67dc', '498f6960-c2a2-4bff-a1da-250641089910', '15502f06-2d2a-414e-a311-4837d6fd6ccf', '8a96d042-9dce-4e33-8f8e-41e79973c1f4'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:23:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:03 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:23:03 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:03 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:23:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-3cfa4536-d0fd-494f-bb45-c3bdd7074f3a tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "cinder-3c520e5a-b697-4327-af77-65249e089012-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:03 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:23:03 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-3cfa4536-d0fd-494f-bb45-c3bdd7074f3a tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-3c520e5a-b697-4327-af77-65249e089012-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-3cfa4536-d0fd-494f-bb45-c3bdd7074f3a tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "cinder-quobyte-3c520e5a-b697-4327-af77-65249e089012" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-3cfa4536-d0fd-494f-bb45-c3bdd7074f3a tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-quobyte-3c520e5a-b697-4327-af77-65249e089012" acquired by "delete_volume" :: waited 0.027s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:03 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.751s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:03 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:23:03 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Deleted volume successfully. Nov 03 08:23:04 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce72552-94c2-4340-a946-6010855e0e6b]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:23:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3cfa4536-d0fd-494f-bb45-c3bdd7074f3a tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3c520e5a-b697-4327-af77-65249e089012 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c848dbdc-b5ae-4079-8eaa-3a717a68af10 tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-4c989f7d-8c7c-42d5-9a1b-e1f3f226729b-delete_volume" released by "delete_volume" :: held 5.358s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:04 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3c520e5a-b697-4327-af77-65249e089012 Nov 03 08:23:04 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:04 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.593s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:04 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:23:04 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager._thread_info {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:23:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread count: 29 {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 08:23:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread info: [<_MainThread(MainThread, started 139707544170624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 08:23:04 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3cfa4536-d0fd-494f-bb45-c3bdd7074f3a tempest-VolumesDeleteCascade-1810668529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3c520e5a-b697-4327-af77-65249e089012" returned: 0 in 0.649s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3cfa4536-d0fd-494f-bb45-c3bdd7074f3a tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3c520e5a-b697-4327-af77-65249e089012 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:04 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3c520e5a-b697-4327-af77-65249e089012 Nov 03 08:23:04 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:05 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3cfa4536-d0fd-494f-bb45-c3bdd7074f3a tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3c520e5a-b697-4327-af77-65249e089012" returned: 0 in 0.412s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-3cfa4536-d0fd-494f-bb45-c3bdd7074f3a tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-quobyte-3c520e5a-b697-4327-af77-65249e089012" released by "delete_volume" :: held 1.203s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:05 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-3cfa4536-d0fd-494f-bb45-c3bdd7074f3a tempest-VolumesDeleteCascade-1810668529 None] Created reservations ['ebdc82de-094b-459a-9a6b-9eeafa00fbb8', 'de07a9ae-475e-470d-9848-b349826e4a0c', '96e2c34c-609a-4ca6-9262-3899e66c41da', '6bf592c4-0521-477b-8798-0de966cd38ee'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:23:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3cfa4536-d0fd-494f-bb45-c3bdd7074f3a tempest-VolumesDeleteCascade-1810668529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3cfa4536-d0fd-494f-bb45-c3bdd7074f3a tempest-VolumesDeleteCascade-1810668529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:05 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-3cfa4536-d0fd-494f-bb45-c3bdd7074f3a tempest-VolumesDeleteCascade-1810668529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:05 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-3cfa4536-d0fd-494f-bb45-c3bdd7074f3a tempest-VolumesDeleteCascade-1810668529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3cfa4536-d0fd-494f-bb45-c3bdd7074f3a tempest-VolumesDeleteCascade-1810668529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3cfa4536-d0fd-494f-bb45-c3bdd7074f3a tempest-VolumesDeleteCascade-1810668529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:05 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:23:05 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:05 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:23:05 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Flow 'volume_create_manager' (770a69c1-a336-45ba-8f6c-5d56c0a99030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394bcc4f-df69-49a9-8ed9-e2a5829c76ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3cfa4536-d0fd-494f-bb45-c3bdd7074f3a tempest-VolumesDeleteCascade-1810668529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.716s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:06 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-3cfa4536-d0fd-494f-bb45-c3bdd7074f3a tempest-VolumesDeleteCascade-1810668529 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:23:06 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-3cfa4536-d0fd-494f-bb45-c3bdd7074f3a tempest-VolumesDeleteCascade-1810668529 None] Deleted volume successfully. Nov 03 08:23:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394bcc4f-df69-49a9-8ed9-e2a5829c76ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2007223961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5917308-bbfe-4280-a30d-8f5c99e13f80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4800f6bd3e8e44b99bc21306568494d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:06Z,use_quota=True,user_id='6842cb1abda04912a8fa0ed42a4394d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2eeebcf-5364-4356-a641-d1239adf32f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2eeebcf-5364-4356-a641-d1239adf32f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87151441-da87-4640-a4e8-ea1c9d4ec712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87151441-da87-4640-a4e8-ea1c9d4ec712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5917308-bbfe-4280-a30d-8f5c99e13f80', 'volume_name': 'volume-d5917308-bbfe-4280-a30d-8f5c99e13f80', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bd60112-4f49-40b9-9244-fdb30f0030d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bd60112-4f49-40b9-9244-fdb30f0030d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6fed51a-a304-43bf-a8a5-103a261ad448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:06 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Volume d5917308-bbfe-4280-a30d-8f5c99e13f80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5917308-bbfe-4280-a30d-8f5c99e13f80', 'volume_size': 1} Nov 03 08:23:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2007223961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5917308-bbfe-4280-a30d-8f5c99e13f80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4800f6bd3e8e44b99bc21306568494d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:06Z,use_quota=True,user_id='6842cb1abda04912a8fa0ed42a4394d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:23:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Creating volume d5917308-bbfe-4280-a30d-8f5c99e13f80 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:23:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:23:06 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:23:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d5917308-bbfe-4280-a30d-8f5c99e13f80 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:06 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d5917308-bbfe-4280-a30d-8f5c99e13f80 1073741824 Nov 03 08:23:06 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:06 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-3cfa4536-d0fd-494f-bb45-c3bdd7074f3a tempest-VolumesDeleteCascade-1810668529 None] Lock "cinder-3c520e5a-b697-4327-af77-65249e089012-delete_volume" released by "delete_volume" :: held 2.494s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:07 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d5917308-bbfe-4280-a30d-8f5c99e13f80 1073741824" returned: 0 in 0.914s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:07 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-58f7ad9f-0cd3-4bc6-b294-a203b43385e5 req-8b0591be-ee87-4035-9ddf-43756422aa91 tempest-TestMinimumBasicScenario-226366604 None] Terminate volume connection completed successfully. Nov 03 08:23:07 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-58f7ad9f-0cd3-4bc6-b294-a203b43385e5 req-8b0591be-ee87-4035-9ddf-43756422aa91 tempest-TestMinimumBasicScenario-226366604 None] Deleting attachment a11cd6e4-75b4-4a79-b960-2fa4bdffb1b7. {{(pid=86801) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 08:23:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d5917308-bbfe-4280-a30d-8f5c99e13f80 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:07 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d5917308-bbfe-4280-a30d-8f5c99e13f80 Nov 03 08:23:07 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:07 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d5917308-bbfe-4280-a30d-8f5c99e13f80" returned: 0 in 0.495s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:07 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:23:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:07 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6fed51a-a304-43bf-a8a5-103a261ad448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5917308-bbfe-4280-a30d-8f5c99e13f80', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:07 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a95863-d9fa-45ae-9e83-b9259690b168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:07 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Volume volume-d5917308-bbfe-4280-a30d-8f5c99e13f80 (d5917308-bbfe-4280-a30d-8f5c99e13f80): created successfully Nov 03 08:23:07 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a95863-d9fa-45ae-9e83-b9259690b168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:07 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Flow 'volume_create_manager' (770a69c1-a336-45ba-8f6c-5d56c0a99030) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:07 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-e03b0823-9243-4c5a-9100-474c5b13bbd7 tempest-VolumesActionsTest-286286620 None] Created volume successfully. Nov 03 08:23:08 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8f1d6933-dff4-4fcf-8863-834549d0e803 tempest-TestMinimumBasicScenario-226366604 None] Acquiring lock "cinder-d71f256c-605c-4f0a-beb5-97b55b5acc14-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:08 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-653acb28-e939-4286-a359-54931d0ffd53 tempest-VolumesActionsTest-286286620 None] Acquiring lock "cinder-d5917308-bbfe-4280-a30d-8f5c99e13f80" by "attach_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:08 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8f1d6933-dff4-4fcf-8863-834549d0e803 tempest-TestMinimumBasicScenario-226366604 None] Lock "cinder-d71f256c-605c-4f0a-beb5-97b55b5acc14-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:08 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-653acb28-e939-4286-a359-54931d0ffd53 tempest-VolumesActionsTest-286286620 None] Lock "cinder-d5917308-bbfe-4280-a30d-8f5c99e13f80" acquired by "attach_volume" :: waited 0.072s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:08 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8f1d6933-dff4-4fcf-8863-834549d0e803 tempest-TestMinimumBasicScenario-226366604 None] Acquiring lock "cinder-quobyte-d71f256c-605c-4f0a-beb5-97b55b5acc14" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:08 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8f1d6933-dff4-4fcf-8863-834549d0e803 tempest-TestMinimumBasicScenario-226366604 None] Lock "cinder-quobyte-d71f256c-605c-4f0a-beb5-97b55b5acc14" acquired by "delete_volume" :: waited 0.047s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:08 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-653acb28-e939-4286-a359-54931d0ffd53 tempest-VolumesActionsTest-286286620 None] Attaching volume d5917308-bbfe-4280-a30d-8f5c99e13f80 to instance 4a2f3804-f93e-4056-a058-aa7a0914c80a at mountpoint /dev/vdb on host None. Nov 03 08:23:08 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab62b1d0-f78c-4d52-a5d3-5d6e81981118]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:23:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8f1d6933-dff4-4fcf-8863-834549d0e803 tempest-TestMinimumBasicScenario-226366604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d71f256c-605c-4f0a-beb5-97b55b5acc14 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:08 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-653acb28-e939-4286-a359-54931d0ffd53 tempest-VolumesActionsTest-286286620 None] Attach volume completed successfully. Nov 03 08:23:08 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-653acb28-e939-4286-a359-54931d0ffd53 tempest-VolumesActionsTest-286286620 None] Lock "cinder-d5917308-bbfe-4280-a30d-8f5c99e13f80" released by "attach_volume" :: held 0.282s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:08 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d71f256c-605c-4f0a-beb5-97b55b5acc14 Nov 03 08:23:08 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:08 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8f1d6933-dff4-4fcf-8863-834549d0e803 tempest-TestMinimumBasicScenario-226366604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d71f256c-605c-4f0a-beb5-97b55b5acc14" returned: 0 in 0.540s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8f1d6933-dff4-4fcf-8863-834549d0e803 tempest-TestMinimumBasicScenario-226366604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d71f256c-605c-4f0a-beb5-97b55b5acc14 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:08 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d71f256c-605c-4f0a-beb5-97b55b5acc14 Nov 03 08:23:08 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:09 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8f1d6933-dff4-4fcf-8863-834549d0e803 tempest-TestMinimumBasicScenario-226366604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d71f256c-605c-4f0a-beb5-97b55b5acc14" returned: 0 in 0.565s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:09 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8f1d6933-dff4-4fcf-8863-834549d0e803 tempest-TestMinimumBasicScenario-226366604 None] Lock "cinder-quobyte-d71f256c-605c-4f0a-beb5-97b55b5acc14" released by "delete_volume" :: held 1.184s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:09 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-8f1d6933-dff4-4fcf-8863-834549d0e803 tempest-TestMinimumBasicScenario-226366604 None] Created reservations ['c9ee0193-5d28-4394-b11b-eab31fd68bd9', '69328ca4-0573-46c0-8eab-e3ef034f7274', 'fe2250ea-ad9a-48ca-a22b-c0737abcf36d', '34e6a5bc-9f1d-4223-93fc-6172db5a9568'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:23:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8f1d6933-dff4-4fcf-8863-834549d0e803 tempest-TestMinimumBasicScenario-226366604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8f1d6933-dff4-4fcf-8863-834549d0e803 tempest-TestMinimumBasicScenario-226366604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8f1d6933-dff4-4fcf-8863-834549d0e803 tempest-TestMinimumBasicScenario-226366604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8f1d6933-dff4-4fcf-8863-834549d0e803 tempest-TestMinimumBasicScenario-226366604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8f1d6933-dff4-4fcf-8863-834549d0e803 tempest-TestMinimumBasicScenario-226366604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8f1d6933-dff4-4fcf-8863-834549d0e803 tempest-TestMinimumBasicScenario-226366604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:09 devstack sudo[97375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:23:09 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:10 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8f1d6933-dff4-4fcf-8863-834549d0e803 tempest-TestMinimumBasicScenario-226366604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.430s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:10 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-8f1d6933-dff4-4fcf-8863-834549d0e803 tempest-TestMinimumBasicScenario-226366604 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:23:10 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-8f1d6933-dff4-4fcf-8863-834549d0e803 tempest-TestMinimumBasicScenario-226366604 None] Deleted volume successfully. Nov 03 08:23:10 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8f1d6933-dff4-4fcf-8863-834549d0e803 tempest-TestMinimumBasicScenario-226366604 None] Lock "cinder-d71f256c-605c-4f0a-beb5-97b55b5acc14-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:10 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-be21ba69-cdde-4adf-ae0f-3dc2e5c51f04 tempest-VolumesActionsTest-1430166995 None] Terminate volume connection completed successfully. Nov 03 08:23:10 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-be21ba69-cdde-4adf-ae0f-3dc2e5c51f04 tempest-VolumesActionsTest-1430166995 None] Acquiring lock "cinder-d5917308-bbfe-4280-a30d-8f5c99e13f80-detach_volume" by "detach_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:10 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-be21ba69-cdde-4adf-ae0f-3dc2e5c51f04 tempest-VolumesActionsTest-1430166995 None] Lock "cinder-d5917308-bbfe-4280-a30d-8f5c99e13f80-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:10 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-be21ba69-cdde-4adf-ae0f-3dc2e5c51f04 tempest-VolumesActionsTest-1430166995 None] Detaching volume d5917308-bbfe-4280-a30d-8f5c99e13f80 from instance 4a2f3804-f93e-4056-a058-aa7a0914c80a. Nov 03 08:23:10 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-be21ba69-cdde-4adf-ae0f-3dc2e5c51f04 tempest-VolumesActionsTest-1430166995 None] Detach volume completed successfully. Nov 03 08:23:10 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-be21ba69-cdde-4adf-ae0f-3dc2e5c51f04 tempest-VolumesActionsTest-1430166995 None] Lock "cinder-d5917308-bbfe-4280-a30d-8f5c99e13f80-detach_volume" released by "detach_volume" :: held 0.124s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:10 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-011ea376-9e15-482b-a698-67ed70690aea tempest-VolumesActionsTest-286286620 None] Acquiring lock "cinder-d5917308-bbfe-4280-a30d-8f5c99e13f80-detach_volume" by "detach_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:10 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-011ea376-9e15-482b-a698-67ed70690aea tempest-VolumesActionsTest-286286620 None] Lock "cinder-d5917308-bbfe-4280-a30d-8f5c99e13f80-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:10 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-011ea376-9e15-482b-a698-67ed70690aea tempest-VolumesActionsTest-286286620 None] Volume detach called, but volume not attached. Nov 03 08:23:10 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-011ea376-9e15-482b-a698-67ed70690aea tempest-VolumesActionsTest-286286620 None] Lock "cinder-d5917308-bbfe-4280-a30d-8f5c99e13f80-detach_volume" released by "detach_volume" :: held 0.046s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:11 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1469a3c7-0309-4677-bf16-9c7a4b89fc0a tempest-VolumesActionsTest-286286620 None] Acquiring lock "cinder-d5917308-bbfe-4280-a30d-8f5c99e13f80-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:11 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1469a3c7-0309-4677-bf16-9c7a4b89fc0a tempest-VolumesActionsTest-286286620 None] Lock "cinder-d5917308-bbfe-4280-a30d-8f5c99e13f80-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:11 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1469a3c7-0309-4677-bf16-9c7a4b89fc0a tempest-VolumesActionsTest-286286620 None] Acquiring lock "cinder-quobyte-d5917308-bbfe-4280-a30d-8f5c99e13f80" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:11 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1469a3c7-0309-4677-bf16-9c7a4b89fc0a tempest-VolumesActionsTest-286286620 None] Lock "cinder-quobyte-d5917308-bbfe-4280-a30d-8f5c99e13f80" acquired by "delete_volume" :: waited 0.037s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:11 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb1ccbb-e56f-45d7-8224-3ce486e2d7e0]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:23:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1469a3c7-0309-4677-bf16-9c7a4b89fc0a tempest-VolumesActionsTest-286286620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d5917308-bbfe-4280-a30d-8f5c99e13f80 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:12 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d5917308-bbfe-4280-a30d-8f5c99e13f80 Nov 03 08:23:12 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:12 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1469a3c7-0309-4677-bf16-9c7a4b89fc0a tempest-VolumesActionsTest-286286620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d5917308-bbfe-4280-a30d-8f5c99e13f80" returned: 0 in 0.745s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1469a3c7-0309-4677-bf16-9c7a4b89fc0a tempest-VolumesActionsTest-286286620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d5917308-bbfe-4280-a30d-8f5c99e13f80 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:12 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d5917308-bbfe-4280-a30d-8f5c99e13f80 Nov 03 08:23:12 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:13 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1469a3c7-0309-4677-bf16-9c7a4b89fc0a tempest-VolumesActionsTest-286286620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d5917308-bbfe-4280-a30d-8f5c99e13f80" returned: 0 in 0.528s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:13 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1469a3c7-0309-4677-bf16-9c7a4b89fc0a tempest-VolumesActionsTest-286286620 None] Lock "cinder-quobyte-d5917308-bbfe-4280-a30d-8f5c99e13f80" released by "delete_volume" :: held 1.394s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:13 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-1469a3c7-0309-4677-bf16-9c7a4b89fc0a tempest-VolumesActionsTest-286286620 None] Created reservations ['e22540ca-e776-4344-b39d-44a83b286b7d', '490bdec9-6d55-4f47-aba9-875388f5f757', '8ad56481-d908-44c6-b528-94eaa2fa1446', 'd723dd51-e497-449a-a162-e8a3a3cc93e8'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:23:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1469a3c7-0309-4677-bf16-9c7a4b89fc0a tempest-VolumesActionsTest-286286620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1469a3c7-0309-4677-bf16-9c7a4b89fc0a tempest-VolumesActionsTest-286286620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:13 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1469a3c7-0309-4677-bf16-9c7a4b89fc0a tempest-VolumesActionsTest-286286620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:13 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1469a3c7-0309-4677-bf16-9c7a4b89fc0a tempest-VolumesActionsTest-286286620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1469a3c7-0309-4677-bf16-9c7a4b89fc0a tempest-VolumesActionsTest-286286620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1469a3c7-0309-4677-bf16-9c7a4b89fc0a tempest-VolumesActionsTest-286286620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:13 devstack sudo[97409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:23:13 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:13 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1469a3c7-0309-4677-bf16-9c7a4b89fc0a tempest-VolumesActionsTest-286286620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.471s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:13 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-1469a3c7-0309-4677-bf16-9c7a4b89fc0a tempest-VolumesActionsTest-286286620 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:23:13 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-1469a3c7-0309-4677-bf16-9c7a4b89fc0a tempest-VolumesActionsTest-286286620 None] Deleted volume successfully. Nov 03 08:23:13 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1469a3c7-0309-4677-bf16-9c7a4b89fc0a tempest-VolumesActionsTest-286286620 None] Lock "cinder-d5917308-bbfe-4280-a30d-8f5c99e13f80-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:16 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:23:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Flow 'volume_create_manager' (38d2e8c2-abef-408e-8e96-0eb044f5ef5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b34bee-5c6e-40cb-853e-93e81e52dfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b34bee-5c6e-40cb-853e-93e81e52dfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1733415251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd399ba-a294-4758-a2dc-2e2be934723d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d31a4d055504b73b9e8a428e5438d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:17Z,use_quota=True,user_id='e0208238d45a419d85a12fc986cd7564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54703a53-9721-40d9-85bc-11279dbbbbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54703a53-9721-40d9-85bc-11279dbbbbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1d06eb-f150-47cb-a53d-2bf5c5646ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1d06eb-f150-47cb-a53d-2bf5c5646ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bd399ba-a294-4758-a2dc-2e2be934723d', 'volume_name': 'volume-6bd399ba-a294-4758-a2dc-2e2be934723d', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a61a70-7199-4d1b-86fc-985df6036526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a61a70-7199-4d1b-86fc-985df6036526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3418026a-475f-4790-9705-d6939e0558fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:16 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Volume 6bd399ba-a294-4758-a2dc-2e2be934723d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bd399ba-a294-4758-a2dc-2e2be934723d', 'volume_size': 1} Nov 03 08:23:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1733415251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd399ba-a294-4758-a2dc-2e2be934723d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d31a4d055504b73b9e8a428e5438d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:17Z,use_quota=True,user_id='e0208238d45a419d85a12fc986cd7564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:23:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Creating volume 6bd399ba-a294-4758-a2dc-2e2be934723d {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:23:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:23:16 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:23:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6bd399ba-a294-4758-a2dc-2e2be934723d 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:16 devstack sudo[97436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6bd399ba-a294-4758-a2dc-2e2be934723d 1073741824 Nov 03 08:23:16 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:17 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6bd399ba-a294-4758-a2dc-2e2be934723d 1073741824" returned: 0 in 0.602s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6bd399ba-a294-4758-a2dc-2e2be934723d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:17 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6bd399ba-a294-4758-a2dc-2e2be934723d Nov 03 08:23:17 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:17 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6bd399ba-a294-4758-a2dc-2e2be934723d" returned: 0 in 0.341s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:17 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:23:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3418026a-475f-4790-9705-d6939e0558fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bd399ba-a294-4758-a2dc-2e2be934723d', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07bb3158-2aff-4022-a333-a18e67937c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:17 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Volume volume-6bd399ba-a294-4758-a2dc-2e2be934723d (6bd399ba-a294-4758-a2dc-2e2be934723d): created successfully Nov 03 08:23:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07bb3158-2aff-4022-a333-a18e67937c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Flow 'volume_create_manager' (38d2e8c2-abef-408e-8e96-0eb044f5ef5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:17 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-9066c658-8dce-4678-b03b-c6e37e8eb6be tempest-VolumesTransfersV357Test-650558415 None] Created volume successfully. Nov 03 08:23:18 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:23:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Flow 'volume_create_manager' (551d7052-f30d-463f-af46-529ddf4bd127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e6a334-b2d3-4a18-8f4b-70cd2e3b2cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e6a334-b2d3-4a18-8f4b-70cd2e3b2cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1627441229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4332d13-1923-4cbf-a51d-272d473a9690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4800f6bd3e8e44b99bc21306568494d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:18Z,use_quota=True,user_id='6842cb1abda04912a8fa0ed42a4394d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66169581-6075-49d9-a2ae-5298a5d8f0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66169581-6075-49d9-a2ae-5298a5d8f0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85751c42-2c5b-4bde-a742-524fe81b07e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85751c42-2c5b-4bde-a742-524fe81b07e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4332d13-1923-4cbf-a51d-272d473a9690', 'volume_name': 'volume-f4332d13-1923-4cbf-a51d-272d473a9690', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd935bc-b623-4c30-9230-918f743bbe26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd935bc-b623-4c30-9230-918f743bbe26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8cc1242-bc33-429e-b5d9-f3b11bf6e182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:18 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Volume f4332d13-1923-4cbf-a51d-272d473a9690: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4332d13-1923-4cbf-a51d-272d473a9690', 'volume_size': 1} Nov 03 08:23:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:18 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1627441229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4332d13-1923-4cbf-a51d-272d473a9690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4800f6bd3e8e44b99bc21306568494d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:18Z,use_quota=True,user_id='6842cb1abda04912a8fa0ed42a4394d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:23:18 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Creating volume f4332d13-1923-4cbf-a51d-272d473a9690 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:23:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:18 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:18 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:18 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:23:18 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:23:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f4332d13-1923-4cbf-a51d-272d473a9690 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:18 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f4332d13-1923-4cbf-a51d-272d473a9690 1073741824 Nov 03 08:23:18 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:19 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f4332d13-1923-4cbf-a51d-272d473a9690 1073741824" returned: 0 in 0.591s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f4332d13-1923-4cbf-a51d-272d473a9690 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:19 devstack sudo[97452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f4332d13-1923-4cbf-a51d-272d473a9690 Nov 03 08:23:19 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:19 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f4332d13-1923-4cbf-a51d-272d473a9690" returned: 0 in 0.348s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:19 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:23:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8cc1242-bc33-429e-b5d9-f3b11bf6e182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4332d13-1923-4cbf-a51d-272d473a9690', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162a2ef4-77af-400e-91fc-15890e298223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:19 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Volume volume-f4332d13-1923-4cbf-a51d-272d473a9690 (f4332d13-1923-4cbf-a51d-272d473a9690): created successfully Nov 03 08:23:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162a2ef4-77af-400e-91fc-15890e298223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Flow 'volume_create_manager' (551d7052-f30d-463f-af46-529ddf4bd127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:19 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-1e709b36-082e-45ad-82f3-c7d2a95b03a9 tempest-VolumesTransfersV357Test-31280425 None] Transfer volume completed successfully. Nov 03 08:23:19 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-fe408fce-f2e7-4297-a194-1bc5320e2d4c tempest-VolumesActionsTest-286286620 None] Created volume successfully. Nov 03 08:23:20 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b6ef7cd1-072e-46ca-941b-949c93728231 tempest-VolumesTransfersV357Test-724455927 None] Acquiring lock "cinder-6bd399ba-a294-4758-a2dc-2e2be934723d-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:20 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b6ef7cd1-072e-46ca-941b-949c93728231 tempest-VolumesTransfersV357Test-724455927 None] Lock "cinder-6bd399ba-a294-4758-a2dc-2e2be934723d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:20 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b6ef7cd1-072e-46ca-941b-949c93728231 tempest-VolumesTransfersV357Test-724455927 None] Acquiring lock "cinder-quobyte-6bd399ba-a294-4758-a2dc-2e2be934723d" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:20 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b6ef7cd1-072e-46ca-941b-949c93728231 tempest-VolumesTransfersV357Test-724455927 None] Lock "cinder-quobyte-6bd399ba-a294-4758-a2dc-2e2be934723d" acquired by "delete_volume" :: waited 0.021s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:20 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a795e1-d9d4-4ae8-bdfc-faacedc9134d]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:23:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b6ef7cd1-072e-46ca-941b-949c93728231 tempest-VolumesTransfersV357Test-724455927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6bd399ba-a294-4758-a2dc-2e2be934723d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:20 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6bd399ba-a294-4758-a2dc-2e2be934723d Nov 03 08:23:20 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:20 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5c8e484b-4aa1-4f38-a443-7b9e005f37c8 tempest-VolumesActionsTest-1430166995 None] Acquiring lock "cinder-f4332d13-1923-4cbf-a51d-272d473a9690-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:20 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5c8e484b-4aa1-4f38-a443-7b9e005f37c8 tempest-VolumesActionsTest-1430166995 None] Lock "cinder-f4332d13-1923-4cbf-a51d-272d473a9690-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:20 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5c8e484b-4aa1-4f38-a443-7b9e005f37c8 tempest-VolumesActionsTest-1430166995 None] Acquiring lock "cinder-quobyte-f4332d13-1923-4cbf-a51d-272d473a9690" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:20 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5c8e484b-4aa1-4f38-a443-7b9e005f37c8 tempest-VolumesActionsTest-1430166995 None] Lock "cinder-quobyte-f4332d13-1923-4cbf-a51d-272d473a9690" acquired by "delete_volume" :: waited 0.015s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:20 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5b470e-8234-45c5-a21f-186bc915e9bd]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:23:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5c8e484b-4aa1-4f38-a443-7b9e005f37c8 tempest-VolumesActionsTest-1430166995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f4332d13-1923-4cbf-a51d-272d473a9690 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:20 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b6ef7cd1-072e-46ca-941b-949c93728231 tempest-VolumesTransfersV357Test-724455927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6bd399ba-a294-4758-a2dc-2e2be934723d" returned: 0 in 0.464s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b6ef7cd1-072e-46ca-941b-949c93728231 tempest-VolumesTransfersV357Test-724455927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6bd399ba-a294-4758-a2dc-2e2be934723d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:20 devstack sudo[97458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f4332d13-1923-4cbf-a51d-272d473a9690 Nov 03 08:23:20 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:20 devstack sudo[97461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6bd399ba-a294-4758-a2dc-2e2be934723d Nov 03 08:23:20 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:21 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5c8e484b-4aa1-4f38-a443-7b9e005f37c8 tempest-VolumesActionsTest-1430166995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f4332d13-1923-4cbf-a51d-272d473a9690" returned: 0 in 0.515s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5c8e484b-4aa1-4f38-a443-7b9e005f37c8 tempest-VolumesActionsTest-1430166995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f4332d13-1923-4cbf-a51d-272d473a9690 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:21 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b6ef7cd1-072e-46ca-941b-949c93728231 tempest-VolumesTransfersV357Test-724455927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6bd399ba-a294-4758-a2dc-2e2be934723d" returned: 0 in 0.411s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:21 devstack sudo[97468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f4332d13-1923-4cbf-a51d-272d473a9690 Nov 03 08:23:21 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:21 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b6ef7cd1-072e-46ca-941b-949c93728231 tempest-VolumesTransfersV357Test-724455927 None] Lock "cinder-quobyte-6bd399ba-a294-4758-a2dc-2e2be934723d" released by "delete_volume" :: held 0.940s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:21 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-b6ef7cd1-072e-46ca-941b-949c93728231 tempest-VolumesTransfersV357Test-724455927 None] Created reservations ['c6ffe1a4-b3dd-489c-a506-82870d100c43', 'e3fd5b52-6fe9-46bc-a4a2-1a5c9cc037c2', 'fb112a49-cd37-466e-9a1e-223d39ff9dd7', '81bf5708-dd89-4616-afd8-3d6d25ee9f75'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:23:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b6ef7cd1-072e-46ca-941b-949c93728231 tempest-VolumesTransfersV357Test-724455927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b6ef7cd1-072e-46ca-941b-949c93728231 tempest-VolumesTransfersV357Test-724455927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:21 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b6ef7cd1-072e-46ca-941b-949c93728231 tempest-VolumesTransfersV357Test-724455927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:21 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b6ef7cd1-072e-46ca-941b-949c93728231 tempest-VolumesTransfersV357Test-724455927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b6ef7cd1-072e-46ca-941b-949c93728231 tempest-VolumesTransfersV357Test-724455927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b6ef7cd1-072e-46ca-941b-949c93728231 tempest-VolumesTransfersV357Test-724455927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:21 devstack sudo[97470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:23:21 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:21 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5c8e484b-4aa1-4f38-a443-7b9e005f37c8 tempest-VolumesActionsTest-1430166995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f4332d13-1923-4cbf-a51d-272d473a9690" returned: 0 in 0.354s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:21 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5c8e484b-4aa1-4f38-a443-7b9e005f37c8 tempest-VolumesActionsTest-1430166995 None] Lock "cinder-quobyte-f4332d13-1923-4cbf-a51d-272d473a9690" released by "delete_volume" :: held 0.933s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:21 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-5c8e484b-4aa1-4f38-a443-7b9e005f37c8 tempest-VolumesActionsTest-1430166995 None] Created reservations ['15d4c313-8836-452e-9542-faaa503e94fb', '94e254ca-5286-4c7e-a6bf-bcbdd10c8945', '649390b4-ca99-4626-8e4a-3d883fc699d8', 'ca72a7b7-55f2-46a5-a10f-35c05d851825'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:23:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5c8e484b-4aa1-4f38-a443-7b9e005f37c8 tempest-VolumesActionsTest-1430166995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5c8e484b-4aa1-4f38-a443-7b9e005f37c8 tempest-VolumesActionsTest-1430166995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:21 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5c8e484b-4aa1-4f38-a443-7b9e005f37c8 tempest-VolumesActionsTest-1430166995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:21 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5c8e484b-4aa1-4f38-a443-7b9e005f37c8 tempest-VolumesActionsTest-1430166995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5c8e484b-4aa1-4f38-a443-7b9e005f37c8 tempest-VolumesActionsTest-1430166995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5c8e484b-4aa1-4f38-a443-7b9e005f37c8 tempest-VolumesActionsTest-1430166995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:21 devstack sudo[97474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:23:21 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:21 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b6ef7cd1-072e-46ca-941b-949c93728231 tempest-VolumesTransfersV357Test-724455927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.384s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:21 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-b6ef7cd1-072e-46ca-941b-949c93728231 tempest-VolumesTransfersV357Test-724455927 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:23:21 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-b6ef7cd1-072e-46ca-941b-949c93728231 tempest-VolumesTransfersV357Test-724455927 None] Deleted volume successfully. Nov 03 08:23:21 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b6ef7cd1-072e-46ca-941b-949c93728231 tempest-VolumesTransfersV357Test-724455927 None] Lock "cinder-6bd399ba-a294-4758-a2dc-2e2be934723d-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:22 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5c8e484b-4aa1-4f38-a443-7b9e005f37c8 tempest-VolumesActionsTest-1430166995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.331s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:22 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-5c8e484b-4aa1-4f38-a443-7b9e005f37c8 tempest-VolumesActionsTest-1430166995 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:23:22 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-5c8e484b-4aa1-4f38-a443-7b9e005f37c8 tempest-VolumesActionsTest-1430166995 None] Deleted volume successfully. Nov 03 08:23:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5c8e484b-4aa1-4f38-a443-7b9e005f37c8 tempest-VolumesActionsTest-1430166995 None] Lock "cinder-f4332d13-1923-4cbf-a51d-272d473a9690-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:22 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:23:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Flow 'volume_create_manager' (918fa2d2-ec81-460a-befd-2cc613436ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73b5d334-c3cb-405c-abf5-3f25e6db91ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73b5d334-c3cb-405c-abf5-3f25e6db91ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1272996205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80b2ae72-59ad-4c04-ae55-790594ac884d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4800f6bd3e8e44b99bc21306568494d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:23Z,use_quota=True,user_id='6842cb1abda04912a8fa0ed42a4394d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9925e3-d43e-4f12-a10c-5d74d07bc30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9925e3-d43e-4f12-a10c-5d74d07bc30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf8c90e-40f0-459a-bc05-d003668da3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf8c90e-40f0-459a-bc05-d003668da3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80b2ae72-59ad-4c04-ae55-790594ac884d', 'volume_name': 'volume-80b2ae72-59ad-4c04-ae55-790594ac884d', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21af4741-5749-4984-aeed-7aa609954d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21af4741-5749-4984-aeed-7aa609954d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8640bd3-d810-4213-829a-5e520872803e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:22 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Volume 80b2ae72-59ad-4c04-ae55-790594ac884d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80b2ae72-59ad-4c04-ae55-790594ac884d', 'volume_size': 1} Nov 03 08:23:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:22 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1272996205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80b2ae72-59ad-4c04-ae55-790594ac884d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4800f6bd3e8e44b99bc21306568494d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:23Z,use_quota=True,user_id='6842cb1abda04912a8fa0ed42a4394d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:23:22 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Creating volume 80b2ae72-59ad-4c04-ae55-790594ac884d {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:23:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:22 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:22 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:22 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:23:22 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:23:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-80b2ae72-59ad-4c04-ae55-790594ac884d 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:22 devstack sudo[97478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-80b2ae72-59ad-4c04-ae55-790594ac884d 1073741824 Nov 03 08:23:22 devstack sudo[97478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Flow 'volume_create_manager' (ab3b4124-c1be-4c98-b27b-e285036dedf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7043cce-3e43-4144-ad58-2f47063c8551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:23 devstack sudo[97478]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7043cce-3e43-4144-ad58-2f47063c8551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1908122759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=337f34c6-ee24-4fea-b6ac-f31149af8443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d31a4d055504b73b9e8a428e5438d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:23Z,use_quota=True,user_id='e0208238d45a419d85a12fc986cd7564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d65876a0-62d2-4e7c-bfc2-3aeb24653454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d65876a0-62d2-4e7c-bfc2-3aeb24653454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ad6afc-0352-4b32-8f55-de6ca0c71ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ad6afc-0352-4b32-8f55-de6ca0c71ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '337f34c6-ee24-4fea-b6ac-f31149af8443', 'volume_name': 'volume-337f34c6-ee24-4fea-b6ac-f31149af8443', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e21a024-a651-4179-85e0-a1d7c5fdc691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e21a024-a651-4179-85e0-a1d7c5fdc691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5ff4680-f5a6-4481-aff3-d2db5a5fa44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:23 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Volume 337f34c6-ee24-4fea-b6ac-f31149af8443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-337f34c6-ee24-4fea-b6ac-f31149af8443', 'volume_size': 1} Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-80b2ae72-59ad-4c04-ae55-790594ac884d 1073741824" returned: 0 in 0.781s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-80b2ae72-59ad-4c04-ae55-790594ac884d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:23 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-80b2ae72-59ad-4c04-ae55-790594ac884d Nov 03 08:23:23 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:23 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-80b2ae72-59ad-4c04-ae55-790594ac884d" returned: 0 in 0.288s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.336s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1908122759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=337f34c6-ee24-4fea-b6ac-f31149af8443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d31a4d055504b73b9e8a428e5438d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:23Z,use_quota=True,user_id='e0208238d45a419d85a12fc986cd7564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Creating volume 337f34c6-ee24-4fea-b6ac-f31149af8443 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:23:23 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-337f34c6-ee24-4fea-b6ac-f31149af8443 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8640bd3-d810-4213-829a-5e520872803e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80b2ae72-59ad-4c04-ae55-790594ac884d', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2117b245-0eec-46ec-92aa-a78574df2fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:23 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-337f34c6-ee24-4fea-b6ac-f31149af8443 1073741824 Nov 03 08:23:23 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:23 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Volume volume-80b2ae72-59ad-4c04-ae55-790594ac884d (80b2ae72-59ad-4c04-ae55-790594ac884d): created successfully Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2117b245-0eec-46ec-92aa-a78574df2fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Flow 'volume_create_manager' (918fa2d2-ec81-460a-befd-2cc613436ed9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:23 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-cfe3d8f4-6e5e-4004-8414-cdd9677bfd92 tempest-VolumesActionsTest-286286620 None] Created volume successfully. Nov 03 08:23:24 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-337f34c6-ee24-4fea-b6ac-f31149af8443 1073741824" returned: 0 in 0.557s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-337f34c6-ee24-4fea-b6ac-f31149af8443 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:24 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-337f34c6-ee24-4fea-b6ac-f31149af8443 Nov 03 08:23:24 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:24 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-337f34c6-ee24-4fea-b6ac-f31149af8443" returned: 0 in 0.284s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:23:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5ff4680-f5a6-4481-aff3-d2db5a5fa44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-337f34c6-ee24-4fea-b6ac-f31149af8443', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a9eb66-2c4d-4b5d-9c6e-725d4aecd962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:24 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Volume volume-337f34c6-ee24-4fea-b6ac-f31149af8443 (337f34c6-ee24-4fea-b6ac-f31149af8443): created successfully Nov 03 08:23:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a9eb66-2c4d-4b5d-9c6e-725d4aecd962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Flow 'volume_create_manager' (ab3b4124-c1be-4c98-b27b-e285036dedf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:24 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-4df0f664-e195-4f71-9408-1c60bef0bb7e tempest-VolumesTransfersV357Test-650558415 None] Created volume successfully. Nov 03 08:23:24 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-af956376-24ea-4989-86c0-aa27f5e7102d tempest-VolumesActionsTest-1430166995 None] Acquiring lock "cinder-80b2ae72-59ad-4c04-ae55-790594ac884d-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:24 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-af956376-24ea-4989-86c0-aa27f5e7102d tempest-VolumesActionsTest-1430166995 None] Lock "cinder-80b2ae72-59ad-4c04-ae55-790594ac884d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:24 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-af956376-24ea-4989-86c0-aa27f5e7102d tempest-VolumesActionsTest-1430166995 None] Acquiring lock "cinder-quobyte-80b2ae72-59ad-4c04-ae55-790594ac884d" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:24 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-af956376-24ea-4989-86c0-aa27f5e7102d tempest-VolumesActionsTest-1430166995 None] Lock "cinder-quobyte-80b2ae72-59ad-4c04-ae55-790594ac884d" acquired by "delete_volume" :: waited 0.016s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:25 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[5680ffd7-2235-48d5-a4bf-65695af89402]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:23:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-af956376-24ea-4989-86c0-aa27f5e7102d tempest-VolumesActionsTest-1430166995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-80b2ae72-59ad-4c04-ae55-790594ac884d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:25 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-80b2ae72-59ad-4c04-ae55-790594ac884d Nov 03 08:23:25 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:25 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-af956376-24ea-4989-86c0-aa27f5e7102d tempest-VolumesActionsTest-1430166995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-80b2ae72-59ad-4c04-ae55-790594ac884d" returned: 0 in 0.471s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-af956376-24ea-4989-86c0-aa27f5e7102d tempest-VolumesActionsTest-1430166995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-80b2ae72-59ad-4c04-ae55-790594ac884d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:25 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-80b2ae72-59ad-4c04-ae55-790594ac884d Nov 03 08:23:25 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f85c0d46-bb4a-46f9-b503-880e63be82e4 tempest-VolumesTransfersV357Test-724455927 None] Acquiring lock "cinder-337f34c6-ee24-4fea-b6ac-f31149af8443-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f85c0d46-bb4a-46f9-b503-880e63be82e4 tempest-VolumesTransfersV357Test-724455927 None] Lock "cinder-337f34c6-ee24-4fea-b6ac-f31149af8443-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:25 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-af956376-24ea-4989-86c0-aa27f5e7102d tempest-VolumesActionsTest-1430166995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-80b2ae72-59ad-4c04-ae55-790594ac884d" returned: 0 in 0.327s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-af956376-24ea-4989-86c0-aa27f5e7102d tempest-VolumesActionsTest-1430166995 None] Lock "cinder-quobyte-80b2ae72-59ad-4c04-ae55-790594ac884d" released by "delete_volume" :: held 0.864s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f85c0d46-bb4a-46f9-b503-880e63be82e4 tempest-VolumesTransfersV357Test-724455927 None] Acquiring lock "cinder-quobyte-337f34c6-ee24-4fea-b6ac-f31149af8443" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f85c0d46-bb4a-46f9-b503-880e63be82e4 tempest-VolumesTransfersV357Test-724455927 None] Lock "cinder-quobyte-337f34c6-ee24-4fea-b6ac-f31149af8443" acquired by "delete_volume" :: waited 0.016s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:25 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[8221ebb8-340c-4b61-b3f3-b5821fee853c]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:23:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f85c0d46-bb4a-46f9-b503-880e63be82e4 tempest-VolumesTransfersV357Test-724455927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-337f34c6-ee24-4fea-b6ac-f31149af8443 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:25 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-af956376-24ea-4989-86c0-aa27f5e7102d tempest-VolumesActionsTest-1430166995 None] Created reservations ['58d6a31d-c487-49c4-9c8c-0953d0c74a93', 'b5e7a5cf-0d2a-4d3d-ad5c-97f5ed17b066', '84c02aca-c469-4455-90d4-a6845fa5f121', 'f433cb47-cb73-44ed-9419-8bc6397601ca'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:23:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-af956376-24ea-4989-86c0-aa27f5e7102d tempest-VolumesActionsTest-1430166995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-af956376-24ea-4989-86c0-aa27f5e7102d tempest-VolumesActionsTest-1430166995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:26 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-af956376-24ea-4989-86c0-aa27f5e7102d tempest-VolumesActionsTest-1430166995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:26 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-af956376-24ea-4989-86c0-aa27f5e7102d tempest-VolumesActionsTest-1430166995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-af956376-24ea-4989-86c0-aa27f5e7102d tempest-VolumesActionsTest-1430166995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-af956376-24ea-4989-86c0-aa27f5e7102d tempest-VolumesActionsTest-1430166995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:26 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:23:26 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:26 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-337f34c6-ee24-4fea-b6ac-f31149af8443 Nov 03 08:23:26 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:26 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-af956376-24ea-4989-86c0-aa27f5e7102d tempest-VolumesActionsTest-1430166995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.376s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:26 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-af956376-24ea-4989-86c0-aa27f5e7102d tempest-VolumesActionsTest-1430166995 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:23:26 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-af956376-24ea-4989-86c0-aa27f5e7102d tempest-VolumesActionsTest-1430166995 None] Deleted volume successfully. Nov 03 08:23:26 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-af956376-24ea-4989-86c0-aa27f5e7102d tempest-VolumesActionsTest-1430166995 None] Lock "cinder-80b2ae72-59ad-4c04-ae55-790594ac884d-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:26 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f85c0d46-bb4a-46f9-b503-880e63be82e4 tempest-VolumesTransfersV357Test-724455927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-337f34c6-ee24-4fea-b6ac-f31149af8443" returned: 0 in 0.637s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f85c0d46-bb4a-46f9-b503-880e63be82e4 tempest-VolumesTransfersV357Test-724455927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-337f34c6-ee24-4fea-b6ac-f31149af8443 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:26 devstack sudo[97514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-337f34c6-ee24-4fea-b6ac-f31149af8443 Nov 03 08:23:26 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:26 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f85c0d46-bb4a-46f9-b503-880e63be82e4 tempest-VolumesTransfersV357Test-724455927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-337f34c6-ee24-4fea-b6ac-f31149af8443" returned: 0 in 0.432s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f85c0d46-bb4a-46f9-b503-880e63be82e4 tempest-VolumesTransfersV357Test-724455927 None] Lock "cinder-quobyte-337f34c6-ee24-4fea-b6ac-f31149af8443" released by "delete_volume" :: held 1.135s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-f85c0d46-bb4a-46f9-b503-880e63be82e4 tempest-VolumesTransfersV357Test-724455927 None] Created reservations ['6a19f000-768e-410c-ab4e-c8b644edeb10', 'ae09287c-4ffa-4e9e-bcf0-ceb64b454715', 'e8bb6701-44fa-4812-94ff-785da6d4b9c2', '0505c72c-9e2c-4134-b259-f35a5a281a04'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Flow 'volume_create_manager' (a210d572-ca40-4b01-94d1-7402092f0080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (744581ef-ff48-41f5-a546-894df48b2681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (744581ef-ff48-41f5-a546-894df48b2681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1718819449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=475bd4da-9ff0-4644-8ab4-392b33c7e5a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4800f6bd3e8e44b99bc21306568494d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:27Z,use_quota=True,user_id='6842cb1abda04912a8fa0ed42a4394d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ed73f1-716c-4b22-954e-0582b2aa7c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ed73f1-716c-4b22-954e-0582b2aa7c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2bd5e24-25bc-46f1-833d-bc85e7f6991e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2bd5e24-25bc-46f1-833d-bc85e7f6991e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '475bd4da-9ff0-4644-8ab4-392b33c7e5a6', 'volume_name': 'volume-475bd4da-9ff0-4644-8ab4-392b33c7e5a6', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a1a09a-387f-4e3e-9e7e-b71f4a91781c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a1a09a-387f-4e3e-9e7e-b71f4a91781c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52bb8f2f-fea3-4a3f-993c-1ed4f6acd708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:27 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Volume 475bd4da-9ff0-4644-8ab4-392b33c7e5a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-475bd4da-9ff0-4644-8ab4-392b33c7e5a6', 'volume_size': 1} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1718819449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=475bd4da-9ff0-4644-8ab4-392b33c7e5a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4800f6bd3e8e44b99bc21306568494d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:27Z,use_quota=True,user_id='6842cb1abda04912a8fa0ed42a4394d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Creating volume 475bd4da-9ff0-4644-8ab4-392b33c7e5a6 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:23:27 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-475bd4da-9ff0-4644-8ab4-392b33c7e5a6 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:27 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-475bd4da-9ff0-4644-8ab4-392b33c7e5a6 1073741824 Nov 03 08:23:27 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f85c0d46-bb4a-46f9-b503-880e63be82e4 tempest-VolumesTransfersV357Test-724455927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f85c0d46-bb4a-46f9-b503-880e63be82e4 tempest-VolumesTransfersV357Test-724455927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f85c0d46-bb4a-46f9-b503-880e63be82e4 tempest-VolumesTransfersV357Test-724455927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f85c0d46-bb4a-46f9-b503-880e63be82e4 tempest-VolumesTransfersV357Test-724455927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f85c0d46-bb4a-46f9-b503-880e63be82e4 tempest-VolumesTransfersV357Test-724455927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f85c0d46-bb4a-46f9-b503-880e63be82e4 tempest-VolumesTransfersV357Test-724455927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:27 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:23:27 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:27 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f85c0d46-bb4a-46f9-b503-880e63be82e4 tempest-VolumesTransfersV357Test-724455927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.314s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-f85c0d46-bb4a-46f9-b503-880e63be82e4 tempest-VolumesTransfersV357Test-724455927 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:23:27 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-f85c0d46-bb4a-46f9-b503-880e63be82e4 tempest-VolumesTransfersV357Test-724455927 None] Deleted volume successfully. Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f85c0d46-bb4a-46f9-b503-880e63be82e4 tempest-VolumesTransfersV357Test-724455927 None] Lock "cinder-337f34c6-ee24-4fea-b6ac-f31149af8443-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:27 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-475bd4da-9ff0-4644-8ab4-392b33c7e5a6 1073741824" returned: 0 in 0.539s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-475bd4da-9ff0-4644-8ab4-392b33c7e5a6 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:27 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-475bd4da-9ff0-4644-8ab4-392b33c7e5a6 Nov 03 08:23:27 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:28 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-475bd4da-9ff0-4644-8ab4-392b33c7e5a6" returned: 0 in 0.285s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:23:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52bb8f2f-fea3-4a3f-993c-1ed4f6acd708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-475bd4da-9ff0-4644-8ab4-392b33c7e5a6', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71691be5-9a66-4caf-8c47-d087637a0db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:28 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Volume volume-475bd4da-9ff0-4644-8ab4-392b33c7e5a6 (475bd4da-9ff0-4644-8ab4-392b33c7e5a6): created successfully Nov 03 08:23:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71691be5-9a66-4caf-8c47-d087637a0db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Flow 'volume_create_manager' (a210d572-ca40-4b01-94d1-7402092f0080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:28 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-3e5abb75-ce37-4030-bab3-5902941d376a tempest-VolumesActionsTest-286286620 None] Created volume successfully. Nov 03 08:23:29 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:23:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Flow 'volume_create_manager' (385c0ddb-319b-46f1-81dd-a75b6d7dbf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25b435d-c9ca-4d43-89d6-8cfed3bfbb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25b435d-c9ca-4d43-89d6-8cfed3bfbb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1481350556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c82d4837-1606-4b56-8139-146ee99aa1d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b2534e2358467abdb9acf7913090ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:29Z,use_quota=True,user_id='3f7e87d9092749b6b1fb59a0c9a6cfcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1759faa-ca15-4cf7-8c8d-6e3f2d68a0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1759faa-ca15-4cf7-8c8d-6e3f2d68a0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75b18288-05f9-4101-b9a0-da10aba7b218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75b18288-05f9-4101-b9a0-da10aba7b218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c82d4837-1606-4b56-8139-146ee99aa1d4', 'volume_name': 'volume-c82d4837-1606-4b56-8139-146ee99aa1d4', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4723e474-eabd-4edc-b8fa-28b1f67dcf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4723e474-eabd-4edc-b8fa-28b1f67dcf28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5712663b-7eb8-4511-8d59-77dc5623ea6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:29 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Volume c82d4837-1606-4b56-8139-146ee99aa1d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c82d4837-1606-4b56-8139-146ee99aa1d4', 'volume_size': 1} Nov 03 08:23:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1481350556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c82d4837-1606-4b56-8139-146ee99aa1d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b2534e2358467abdb9acf7913090ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:29Z,use_quota=True,user_id='3f7e87d9092749b6b1fb59a0c9a6cfcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:23:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Creating volume c82d4837-1606-4b56-8139-146ee99aa1d4 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:23:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:23:29 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:23:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:29 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-2fbb0299-c967-4f9a-a29a-3b6c5921f69c tempest-VolumesActionsTest-1430166995 None] Acquiring lock "cinder-475bd4da-9ff0-4644-8ab4-392b33c7e5a6-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:29 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-2fbb0299-c967-4f9a-a29a-3b6c5921f69c tempest-VolumesActionsTest-1430166995 None] Lock "cinder-475bd4da-9ff0-4644-8ab4-392b33c7e5a6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:29 devstack sudo[97530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4 1073741824 Nov 03 08:23:29 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:29 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-2fbb0299-c967-4f9a-a29a-3b6c5921f69c tempest-VolumesActionsTest-1430166995 None] Acquiring lock "cinder-quobyte-475bd4da-9ff0-4644-8ab4-392b33c7e5a6" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:29 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-2fbb0299-c967-4f9a-a29a-3b6c5921f69c tempest-VolumesActionsTest-1430166995 None] Lock "cinder-quobyte-475bd4da-9ff0-4644-8ab4-392b33c7e5a6" acquired by "delete_volume" :: waited 0.024s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:29 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d985c3e-038d-4313-8e90-38d202601743]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:23:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2fbb0299-c967-4f9a-a29a-3b6c5921f69c tempest-VolumesActionsTest-1430166995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-475bd4da-9ff0-4644-8ab4-392b33c7e5a6 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:29 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-475bd4da-9ff0-4644-8ab4-392b33c7e5a6 Nov 03 08:23:29 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:30 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4 1073741824" returned: 0 in 0.660s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:30 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2fbb0299-c967-4f9a-a29a-3b6c5921f69c tempest-VolumesActionsTest-1430166995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-475bd4da-9ff0-4644-8ab4-392b33c7e5a6" returned: 0 in 0.543s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2fbb0299-c967-4f9a-a29a-3b6c5921f69c tempest-VolumesActionsTest-1430166995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-475bd4da-9ff0-4644-8ab4-392b33c7e5a6 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:30 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-475bd4da-9ff0-4644-8ab4-392b33c7e5a6 Nov 03 08:23:30 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:30 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4 Nov 03 08:23:30 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:30 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2fbb0299-c967-4f9a-a29a-3b6c5921f69c tempest-VolumesActionsTest-1430166995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-475bd4da-9ff0-4644-8ab4-392b33c7e5a6" returned: 0 in 0.335s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:30 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-2fbb0299-c967-4f9a-a29a-3b6c5921f69c tempest-VolumesActionsTest-1430166995 None] Lock "cinder-quobyte-475bd4da-9ff0-4644-8ab4-392b33c7e5a6" released by "delete_volume" :: held 0.944s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:30 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4" returned: 0 in 0.350s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:23:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5712663b-7eb8-4511-8d59-77dc5623ea6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c82d4837-1606-4b56-8139-146ee99aa1d4', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e43b7ad8-2afd-4d70-94db-8655f7da4b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:30 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Volume volume-c82d4837-1606-4b56-8139-146ee99aa1d4 (c82d4837-1606-4b56-8139-146ee99aa1d4): created successfully Nov 03 08:23:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e43b7ad8-2afd-4d70-94db-8655f7da4b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Flow 'volume_create_manager' (385c0ddb-319b-46f1-81dd-a75b6d7dbf42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:30 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-7bdf03d5-0495-4a54-9fe8-180e32f4cd37 tempest-VolumesActionsTest-383491166 None] Created volume successfully. Nov 03 08:23:30 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-2fbb0299-c967-4f9a-a29a-3b6c5921f69c tempest-VolumesActionsTest-1430166995 None] Created reservations ['18d3ba0c-165b-4662-a620-405d424d678e', '153c9aa7-e2c5-4ba1-a691-0c879d12afc5', '5cce9bb2-454f-448d-b8da-c5994ff16884', '780173a5-5eff-45c2-a9d5-8544ae101fe7'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:23:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2fbb0299-c967-4f9a-a29a-3b6c5921f69c tempest-VolumesActionsTest-1430166995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2fbb0299-c967-4f9a-a29a-3b6c5921f69c tempest-VolumesActionsTest-1430166995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2fbb0299-c967-4f9a-a29a-3b6c5921f69c tempest-VolumesActionsTest-1430166995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2fbb0299-c967-4f9a-a29a-3b6c5921f69c tempest-VolumesActionsTest-1430166995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2fbb0299-c967-4f9a-a29a-3b6c5921f69c tempest-VolumesActionsTest-1430166995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2fbb0299-c967-4f9a-a29a-3b6c5921f69c tempest-VolumesActionsTest-1430166995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:30 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:23:30 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:30 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2fbb0299-c967-4f9a-a29a-3b6c5921f69c tempest-VolumesActionsTest-1430166995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.309s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:30 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-2fbb0299-c967-4f9a-a29a-3b6c5921f69c tempest-VolumesActionsTest-1430166995 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:23:30 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-2fbb0299-c967-4f9a-a29a-3b6c5921f69c tempest-VolumesActionsTest-1430166995 None] Deleted volume successfully. Nov 03 08:23:31 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-2fbb0299-c967-4f9a-a29a-3b6c5921f69c tempest-VolumesActionsTest-1430166995 None] Lock "cinder-475bd4da-9ff0-4644-8ab4-392b33c7e5a6-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Flow 'volume_create_manager' (417876be-8963-4d8c-8d19-8c30166f53e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb52a5b1-efe9-4afc-9dc2-b34e5639d262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb52a5b1-efe9-4afc-9dc2-b34e5639d262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1238060007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a968c4f0-fe4f-4a30-884d-7de08f5aeac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81d587a398d04f4f80034c09f87f0f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:32Z,use_quota=True,user_id='48ec789ee9e74f3ab3a16fb19a19e1de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38fe8bf2-3f40-4a5b-b89d-062e6140cb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38fe8bf2-3f40-4a5b-b89d-062e6140cb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cff9001-11ed-497f-9bcb-135f9de6ff0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cff9001-11ed-497f-9bcb-135f9de6ff0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a968c4f0-fe4f-4a30-884d-7de08f5aeac7', 'volume_name': 'volume-a968c4f0-fe4f-4a30-884d-7de08f5aeac7', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e00b2a9a-3f47-4925-92fb-cb8f5ffb6c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e00b2a9a-3f47-4925-92fb-cb8f5ffb6c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27147a9-886a-454d-b5c5-e47172b95913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:32 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Volume a968c4f0-fe4f-4a30-884d-7de08f5aeac7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a968c4f0-fe4f-4a30-884d-7de08f5aeac7', 'volume_size': 1} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1238060007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a968c4f0-fe4f-4a30-884d-7de08f5aeac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81d587a398d04f4f80034c09f87f0f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:32Z,use_quota=True,user_id='48ec789ee9e74f3ab3a16fb19a19e1de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Creating volume a968c4f0-fe4f-4a30-884d-7de08f5aeac7 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:23:32 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a968c4f0-fe4f-4a30-884d-7de08f5aeac7 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:32 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a968c4f0-fe4f-4a30-884d-7de08f5aeac7 1073741824 Nov 03 08:23:32 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Flow 'volume_create_manager' (1146c770-6ec7-44d0-af15-0a76933e6858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26057b3a-ab92-4a6b-8445-ac0d5b798c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26057b3a-ab92-4a6b-8445-ac0d5b798c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-179031506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e8bd901-6254-4661-af2a-9ef4c99fbfd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4800f6bd3e8e44b99bc21306568494d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:32Z,use_quota=True,user_id='6842cb1abda04912a8fa0ed42a4394d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b80d60-f3d5-4222-a2f9-4fae66c75293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b80d60-f3d5-4222-a2f9-4fae66c75293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874da10d-944a-4a5d-b4da-ecc3e7d8164a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874da10d-944a-4a5d-b4da-ecc3e7d8164a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e8bd901-6254-4661-af2a-9ef4c99fbfd4', 'volume_name': 'volume-3e8bd901-6254-4661-af2a-9ef4c99fbfd4', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6874f96e-289a-4751-ba65-adac20ac3829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6874f96e-289a-4751-ba65-adac20ac3829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b630092c-9c0a-4915-b0da-e950140016ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:32 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Volume 3e8bd901-6254-4661-af2a-9ef4c99fbfd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e8bd901-6254-4661-af2a-9ef4c99fbfd4', 'volume_size': 1} Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:32 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a968c4f0-fe4f-4a30-884d-7de08f5aeac7 1073741824" returned: 0 in 0.614s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a968c4f0-fe4f-4a30-884d-7de08f5aeac7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:33 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a968c4f0-fe4f-4a30-884d-7de08f5aeac7 Nov 03 08:23:33 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:33 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a968c4f0-fe4f-4a30-884d-7de08f5aeac7" returned: 0 in 0.384s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:23:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.839s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-179031506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e8bd901-6254-4661-af2a-9ef4c99fbfd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4800f6bd3e8e44b99bc21306568494d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:32Z,use_quota=True,user_id='6842cb1abda04912a8fa0ed42a4394d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:23:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Creating volume 3e8bd901-6254-4661-af2a-9ef4c99fbfd4 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:23:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:23:33 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:23:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3e8bd901-6254-4661-af2a-9ef4c99fbfd4 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27147a9-886a-454d-b5c5-e47172b95913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a968c4f0-fe4f-4a30-884d-7de08f5aeac7', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:33 devstack sudo[97562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3e8bd901-6254-4661-af2a-9ef4c99fbfd4 1073741824 Nov 03 08:23:33 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a6b1663-e51f-4e47-b2e8-123e408dba2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:33 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Volume volume-a968c4f0-fe4f-4a30-884d-7de08f5aeac7 (a968c4f0-fe4f-4a30-884d-7de08f5aeac7): created successfully Nov 03 08:23:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a6b1663-e51f-4e47-b2e8-123e408dba2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Flow 'volume_create_manager' (417876be-8963-4d8c-8d19-8c30166f53e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:33 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-6742b97a-b478-4a53-b1f3-251056759571 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Created volume successfully. Nov 03 08:23:33 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3e8bd901-6254-4661-af2a-9ef4c99fbfd4 1073741824" returned: 0 in 0.530s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3e8bd901-6254-4661-af2a-9ef4c99fbfd4 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:34 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3e8bd901-6254-4661-af2a-9ef4c99fbfd4 Nov 03 08:23:34 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:34 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3e8bd901-6254-4661-af2a-9ef4c99fbfd4" returned: 0 in 0.334s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:34 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:23:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b630092c-9c0a-4915-b0da-e950140016ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e8bd901-6254-4661-af2a-9ef4c99fbfd4', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a93d1e-1f67-4081-9a37-1bda5b890a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:34 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Volume volume-3e8bd901-6254-4661-af2a-9ef4c99fbfd4 (3e8bd901-6254-4661-af2a-9ef4c99fbfd4): created successfully Nov 03 08:23:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a93d1e-1f67-4081-9a37-1bda5b890a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Flow 'volume_create_manager' (1146c770-6ec7-44d0-af15-0a76933e6858) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:34 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-2613f7d3-6ffc-455e-95d7-1dbcd638a436 tempest-VolumesActionsTest-286286620 None] Created volume successfully. Nov 03 08:23:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ae0d2436-78cb-4720-b493-35f5434fff24 tempest-VolumesActionsTest-1430166995 None] Acquiring lock "cinder-3e8bd901-6254-4661-af2a-9ef4c99fbfd4-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ae0d2436-78cb-4720-b493-35f5434fff24 tempest-VolumesActionsTest-1430166995 None] Lock "cinder-3e8bd901-6254-4661-af2a-9ef4c99fbfd4-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ae0d2436-78cb-4720-b493-35f5434fff24 tempest-VolumesActionsTest-1430166995 None] Acquiring lock "cinder-quobyte-3e8bd901-6254-4661-af2a-9ef4c99fbfd4" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ae0d2436-78cb-4720-b493-35f5434fff24 tempest-VolumesActionsTest-1430166995 None] Lock "cinder-quobyte-3e8bd901-6254-4661-af2a-9ef4c99fbfd4" acquired by "delete_volume" :: waited 0.026s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb5bc85-aeca-40bc-a165-f0b072b3ab26]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ae0d2436-78cb-4720-b493-35f5434fff24 tempest-VolumesActionsTest-1430166995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3e8bd901-6254-4661-af2a-9ef4c99fbfd4 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Flow 'volume_create_manager' (6a6647cc-ff55-4d65-ad4c-466ebb87a2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aafc7fc1-de4a-44ac-814b-c070908bae22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aafc7fc1-de4a-44ac-814b-c070908bae22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1545822190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6193f217-9bf7-4f2f-b714-3eba043cc7a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81d587a398d04f4f80034c09f87f0f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:35Z,use_quota=True,user_id='48ec789ee9e74f3ab3a16fb19a19e1de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0299c123-be06-4c4b-a442-b0ec591deef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0299c123-be06-4c4b-a442-b0ec591deef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (003cc611-b35f-4546-b2ea-54ee378a9da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (003cc611-b35f-4546-b2ea-54ee378a9da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6193f217-9bf7-4f2f-b714-3eba043cc7a5', 'volume_name': 'volume-6193f217-9bf7-4f2f-b714-3eba043cc7a5', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e100256-11af-4ea2-af4f-1cb090c08e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e100256-11af-4ea2-af4f-1cb090c08e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e7b2318-2da0-4e86-a676-6f8a7c8f2c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:35 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Volume 6193f217-9bf7-4f2f-b714-3eba043cc7a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6193f217-9bf7-4f2f-b714-3eba043cc7a5', 'volume_size': 1} Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1545822190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6193f217-9bf7-4f2f-b714-3eba043cc7a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81d587a398d04f4f80034c09f87f0f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:35Z,use_quota=True,user_id='48ec789ee9e74f3ab3a16fb19a19e1de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Creating volume 6193f217-9bf7-4f2f-b714-3eba043cc7a5 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:35 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3e8bd901-6254-4661-af2a-9ef4c99fbfd4 Nov 03 08:23:35 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:23:35 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6193f217-9bf7-4f2f-b714-3eba043cc7a5 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:35 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6193f217-9bf7-4f2f-b714-3eba043cc7a5 1073741824 Nov 03 08:23:35 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:35 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ae0d2436-78cb-4720-b493-35f5434fff24 tempest-VolumesActionsTest-1430166995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3e8bd901-6254-4661-af2a-9ef4c99fbfd4" returned: 0 in 0.727s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ae0d2436-78cb-4720-b493-35f5434fff24 tempest-VolumesActionsTest-1430166995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3e8bd901-6254-4661-af2a-9ef4c99fbfd4 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:35 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3e8bd901-6254-4661-af2a-9ef4c99fbfd4 Nov 03 08:23:35 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Flow 'volume_create_manager' (b7d1ebc6-2d6c-4ba8-b91c-9335a539fc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08dae8d-c75e-4aea-9b31-524b85f8386c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08dae8d-c75e-4aea-9b31-524b85f8386c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1427256498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c68aaa7e-19f5-46ab-a193-6e23807b0a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81d587a398d04f4f80034c09f87f0f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:36Z,use_quota=True,user_id='48ec789ee9e74f3ab3a16fb19a19e1de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:36 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2167e34-8b61-473f-ac96-c7b619c4cfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2167e34-8b61-473f-ac96-c7b619c4cfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f9277a-23f5-4876-a03d-559840373478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f9277a-23f5-4876-a03d-559840373478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c68aaa7e-19f5-46ab-a193-6e23807b0a16', 'volume_name': 'volume-c68aaa7e-19f5-46ab-a193-6e23807b0a16', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fbb678f-4405-4a25-ad9e-d27d25b0057e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fbb678f-4405-4a25-ad9e-d27d25b0057e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05f31858-f37b-44c3-ad2e-46de98b189e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:36 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Volume c68aaa7e-19f5-46ab-a193-6e23807b0a16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c68aaa7e-19f5-46ab-a193-6e23807b0a16', 'volume_size': 1} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6193f217-9bf7-4f2f-b714-3eba043cc7a5 1073741824" returned: 0 in 0.965s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:36 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ae0d2436-78cb-4720-b493-35f5434fff24 tempest-VolumesActionsTest-1430166995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3e8bd901-6254-4661-af2a-9ef4c99fbfd4" returned: 0 in 0.486s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ae0d2436-78cb-4720-b493-35f5434fff24 tempest-VolumesActionsTest-1430166995 None] Lock "cinder-quobyte-3e8bd901-6254-4661-af2a-9ef4c99fbfd4" released by "delete_volume" :: held 1.315s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6193f217-9bf7-4f2f-b714-3eba043cc7a5 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:36 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6193f217-9bf7-4f2f-b714-3eba043cc7a5 Nov 03 08:23:36 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-ae0d2436-78cb-4720-b493-35f5434fff24 tempest-VolumesActionsTest-1430166995 None] Created reservations ['5d5c8ba7-695c-4e0b-8231-90db1f8f44ea', 'c7517a10-457d-4d54-b93f-99f2c51577b8', 'a5148cd6-4bf1-4c0f-b63d-96c75d4030fc', '8deadeed-f0fa-4ad3-8c44-836043c86a3e'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ae0d2436-78cb-4720-b493-35f5434fff24 tempest-VolumesActionsTest-1430166995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ae0d2436-78cb-4720-b493-35f5434fff24 tempest-VolumesActionsTest-1430166995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ae0d2436-78cb-4720-b493-35f5434fff24 tempest-VolumesActionsTest-1430166995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ae0d2436-78cb-4720-b493-35f5434fff24 tempest-VolumesActionsTest-1430166995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ae0d2436-78cb-4720-b493-35f5434fff24 tempest-VolumesActionsTest-1430166995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ae0d2436-78cb-4720-b493-35f5434fff24 tempest-VolumesActionsTest-1430166995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:36 devstack sudo[97604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:23:36 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:23:36 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Flow 'volume_create_manager' (066f0cd7-058b-49af-b5cf-36cd71529ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb44550c-339b-40d5-baf2-56519a460b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6193f217-9bf7-4f2f-b714-3eba043cc7a5" returned: 0 in 0.485s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.578s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1427256498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c68aaa7e-19f5-46ab-a193-6e23807b0a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81d587a398d04f4f80034c09f87f0f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:36Z,use_quota=True,user_id='48ec789ee9e74f3ab3a16fb19a19e1de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Creating volume c68aaa7e-19f5-46ab-a193-6e23807b0a16 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:23:36 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:23:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c68aaa7e-19f5-46ab-a193-6e23807b0a16 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb44550c-339b-40d5-baf2-56519a460b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1147955184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7264815-9c8e-4fb1-91fd-7d5064040b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81d587a398d04f4f80034c09f87f0f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:37Z,use_quota=True,user_id='48ec789ee9e74f3ab3a16fb19a19e1de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:37 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c68aaa7e-19f5-46ab-a193-6e23807b0a16 1073741824 Nov 03 08:23:37 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b38305-7ca7-429b-94cd-95c5123de414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b38305-7ca7-429b-94cd-95c5123de414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b06ec2-c337-46f3-a8a2-724e530f7d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b06ec2-c337-46f3-a8a2-724e530f7d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7264815-9c8e-4fb1-91fd-7d5064040b6d', 'volume_name': 'volume-f7264815-9c8e-4fb1-91fd-7d5064040b6d', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (494a04e7-9e21-441b-8ac0-a6c36d22bf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (494a04e7-9e21-441b-8ac0-a6c36d22bf5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf91729-4bfa-4b4f-be47-c690f87ac344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:37 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Volume f7264815-9c8e-4fb1-91fd-7d5064040b6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7264815-9c8e-4fb1-91fd-7d5064040b6d', 'volume_size': 1} Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e7b2318-2da0-4e86-a676-6f8a7c8f2c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6193f217-9bf7-4f2f-b714-3eba043cc7a5', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe80d71a-c14d-4fc2-9479-58c1824a7cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:37 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Volume volume-6193f217-9bf7-4f2f-b714-3eba043cc7a5 (6193f217-9bf7-4f2f-b714-3eba043cc7a5): created successfully Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe80d71a-c14d-4fc2-9479-58c1824a7cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Flow 'volume_create_manager' (6a6647cc-ff55-4d65-ad4c-466ebb87a2a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:37 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-fe9518d4-ec6b-4c02-946b-59b0680b11d9 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Created volume successfully. Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Flow 'volume_create_manager' (c80ebe11-97c1-48ff-82a0-e8f20b999005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de96c6a0-eea4-49ba-ba50-4e80e208758e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:37 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ae0d2436-78cb-4720-b493-35f5434fff24 tempest-VolumesActionsTest-1430166995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.633s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-ae0d2436-78cb-4720-b493-35f5434fff24 tempest-VolumesActionsTest-1430166995 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de96c6a0-eea4-49ba-ba50-4e80e208758e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1860532952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=215b4319-6b4c-47e1-bac0-3a5f4b37c024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81d587a398d04f4f80034c09f87f0f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:37Z,use_quota=True,user_id='48ec789ee9e74f3ab3a16fb19a19e1de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf896f35-d8ee-4e95-9937-ad122bbb1fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf896f35-d8ee-4e95-9937-ad122bbb1fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c23840d7-5ece-4785-bbd2-205ebfd0149c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c23840d7-5ece-4785-bbd2-205ebfd0149c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '215b4319-6b4c-47e1-bac0-3a5f4b37c024', 'volume_name': 'volume-215b4319-6b4c-47e1-bac0-3a5f4b37c024', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d1c4302-cc4c-4f9b-891b-8e563fb7eeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d1c4302-cc4c-4f9b-891b-8e563fb7eeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada22d3b-f7ca-4fcf-b980-275a4f354a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:37 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Volume 215b4319-6b4c-47e1-bac0-3a5f4b37c024: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-215b4319-6b4c-47e1-bac0-3a5f4b37c024', 'volume_size': 1} Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:37 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-ae0d2436-78cb-4720-b493-35f5434fff24 tempest-VolumesActionsTest-1430166995 None] Deleted volume successfully. Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ae0d2436-78cb-4720-b493-35f5434fff24 tempest-VolumesActionsTest-1430166995 None] Lock "cinder-3e8bd901-6254-4661-af2a-9ef4c99fbfd4-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:37 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c68aaa7e-19f5-46ab-a193-6e23807b0a16 1073741824" returned: 0 in 0.852s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c68aaa7e-19f5-46ab-a193-6e23807b0a16 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:37 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c68aaa7e-19f5-46ab-a193-6e23807b0a16 Nov 03 08:23:37 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:23:38 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Flow 'volume_create_manager' (4b5d852d-6734-4d85-b390-20852634771e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a8e146-5119-400e-9459-9538865dd9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c68aaa7e-19f5-46ab-a193-6e23807b0a16" returned: 0 in 0.399s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] <== create_volume: return (1342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.165s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1147955184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7264815-9c8e-4fb1-91fd-7d5064040b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81d587a398d04f4f80034c09f87f0f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:37Z,use_quota=True,user_id='48ec789ee9e74f3ab3a16fb19a19e1de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Creating volume f7264815-9c8e-4fb1-91fd-7d5064040b6d {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:23:38 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7264815-9c8e-4fb1-91fd-7d5064040b6d 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:38 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7264815-9c8e-4fb1-91fd-7d5064040b6d 1073741824 Nov 03 08:23:38 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a8e146-5119-400e-9459-9538865dd9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-663177353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d489852-89c2-4b90-a548-979ad85f26a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed3224d4e4424775b4b7bf4b0cb2e64d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:38Z,use_quota=True,user_id='b16d42b385844b7eaa30ae765ac02a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea8a2536-1f1e-4527-9229-6bbc9c980197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea8a2536-1f1e-4527-9229-6bbc9c980197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f47eed-ad44-4f7d-b38e-94e5ebace293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f47eed-ad44-4f7d-b38e-94e5ebace293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d489852-89c2-4b90-a548-979ad85f26a4', 'volume_name': 'volume-9d489852-89c2-4b90-a548-979ad85f26a4', 'volume_size': 2}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7f0788-47a7-4b99-b4de-e2e44668228b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7f0788-47a7-4b99-b4de-e2e44668228b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d605944-7799-47ab-b53e-95728c9930c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:38 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Volume 9d489852-89c2-4b90-a548-979ad85f26a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d489852-89c2-4b90-a548-979ad85f26a4', 'volume_size': 2} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05f31858-f37b-44c3-ad2e-46de98b189e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c68aaa7e-19f5-46ab-a193-6e23807b0a16', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43ff558b-bf57-439b-b1dc-df836cc95794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:38 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Volume volume-c68aaa7e-19f5-46ab-a193-6e23807b0a16 (c68aaa7e-19f5-46ab-a193-6e23807b0a16): created successfully Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43ff558b-bf57-439b-b1dc-df836cc95794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Flow 'volume_create_manager' (b7d1ebc6-2d6c-4ba8-b91c-9335a539fc4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Flow 'volume_create_manager' (1816e185-34b2-48f9-af9c-c439b2f09bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5435c25d-fc2f-4cfb-99b6-3a57908ba0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:38 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-fdad1d33-5444-4b68-ace8-e7814cead811 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Created volume successfully. Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5435c25d-fc2f-4cfb-99b6-3a57908ba0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-797211880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fdd57a2-9eb2-4ee6-b08c-f9329775cdd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81d587a398d04f4f80034c09f87f0f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:38Z,use_quota=True,user_id='48ec789ee9e74f3ab3a16fb19a19e1de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15076593-1bda-495b-8be6-bc0041576635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15076593-1bda-495b-8be6-bc0041576635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8702228-547c-4cf5-8f9c-d7dbf8f9e18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8702228-547c-4cf5-8f9c-d7dbf8f9e18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fdd57a2-9eb2-4ee6-b08c-f9329775cdd2', 'volume_name': 'volume-6fdd57a2-9eb2-4ee6-b08c-f9329775cdd2', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a58639-f546-48a5-97dd-caa1f6204fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a58639-f546-48a5-97dd-caa1f6204fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20da5cfd-3d6d-4ae1-91be-680e43cd7320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:38 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Volume 6fdd57a2-9eb2-4ee6-b08c-f9329775cdd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fdd57a2-9eb2-4ee6-b08c-f9329775cdd2', 'volume_size': 1} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Flow 'volume_create_manager' (bf500cc5-4b54-41fe-a39c-be67a2ab1d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39017ad0-f542-4d4f-b501-e45ae4b990ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39017ad0-f542-4d4f-b501-e45ae4b990ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-426217728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=075291ac-6241-44f8-a93e-8fe43c488c8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4800f6bd3e8e44b99bc21306568494d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:38Z,use_quota=True,user_id='6842cb1abda04912a8fa0ed42a4394d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f17f84-35ac-4103-a1fd-439496e38120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f17f84-35ac-4103-a1fd-439496e38120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee7e92c1-c39e-421a-8bc0-7416b641c8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee7e92c1-c39e-421a-8bc0-7416b641c8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '075291ac-6241-44f8-a93e-8fe43c488c8b', 'volume_name': 'volume-075291ac-6241-44f8-a93e-8fe43c488c8b', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (218ad3dd-ec62-416c-b8a1-8b006e4873c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (218ad3dd-ec62-416c-b8a1-8b006e4873c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf801b0-9a02-43d2-90e5-43b9112b8563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:38 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Volume 075291ac-6241-44f8-a93e-8fe43c488c8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-075291ac-6241-44f8-a93e-8fe43c488c8b', 'volume_size': 1} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:38 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7264815-9c8e-4fb1-91fd-7d5064040b6d 1073741824" returned: 0 in 0.488s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7264815-9c8e-4fb1-91fd-7d5064040b6d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:38 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7264815-9c8e-4fb1-91fd-7d5064040b6d Nov 03 08:23:38 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:39 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7264815-9c8e-4fb1-91fd-7d5064040b6d" returned: 0 in 0.589s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:39 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:23:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.988s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:39 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1860532952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=215b4319-6b4c-47e1-bac0-3a5f4b37c024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81d587a398d04f4f80034c09f87f0f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:37Z,use_quota=True,user_id='48ec789ee9e74f3ab3a16fb19a19e1de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:23:39 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Creating volume 215b4319-6b4c-47e1-bac0-3a5f4b37c024 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:23:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:39 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:39 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:39 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:23:39 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:23:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-215b4319-6b4c-47e1-bac0-3a5f4b37c024 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf91729-4bfa-4b4f-be47-c690f87ac344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7264815-9c8e-4fb1-91fd-7d5064040b6d', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:39 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-215b4319-6b4c-47e1-bac0-3a5f4b37c024 1073741824 Nov 03 08:23:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (935bfaa1-0169-4dfe-bf89-524c9a48f3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:39 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:39 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Volume volume-f7264815-9c8e-4fb1-91fd-7d5064040b6d (f7264815-9c8e-4fb1-91fd-7d5064040b6d): created successfully Nov 03 08:23:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (935bfaa1-0169-4dfe-bf89-524c9a48f3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Flow 'volume_create_manager' (066f0cd7-058b-49af-b5cf-36cd71529ad0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:39 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-090af2e1-6a3b-456d-8304-a22f6e660fdc tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Created volume successfully. Nov 03 08:23:40 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-215b4319-6b4c-47e1-bac0-3a5f4b37c024 1073741824" returned: 0 in 0.724s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-215b4319-6b4c-47e1-bac0-3a5f4b37c024 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:40 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-215b4319-6b4c-47e1-bac0-3a5f4b37c024 Nov 03 08:23:40 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:40 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-215b4319-6b4c-47e1-bac0-3a5f4b37c024" returned: 0 in 0.272s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:23:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.047s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-663177353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d489852-89c2-4b90-a548-979ad85f26a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed3224d4e4424775b4b7bf4b0cb2e64d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:38Z,use_quota=True,user_id='b16d42b385844b7eaa30ae765ac02a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:23:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Creating volume 9d489852-89c2-4b90-a548-979ad85f26a4 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:23:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:23:40 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:23:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9d489852-89c2-4b90-a548-979ad85f26a4 2147483648 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:40 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9d489852-89c2-4b90-a548-979ad85f26a4 2147483648 Nov 03 08:23:40 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada22d3b-f7ca-4fcf-b980-275a4f354a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-215b4319-6b4c-47e1-bac0-3a5f4b37c024', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:40 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:40 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0afdf743-5f74-408f-8c6b-62a3c8e7d000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:40 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Volume volume-215b4319-6b4c-47e1-bac0-3a5f4b37c024 (215b4319-6b4c-47e1-bac0-3a5f4b37c024): created successfully Nov 03 08:23:40 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0afdf743-5f74-408f-8c6b-62a3c8e7d000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:40 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Flow 'volume_create_manager' (c80ebe11-97c1-48ff-82a0-e8f20b999005) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:40 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-38dfd47f-b6ef-410b-96e0-1ff1f5d2c430 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Created volume successfully. Nov 03 08:23:41 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9d489852-89c2-4b90-a548-979ad85f26a4 2147483648" returned: 0 in 0.626s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9d489852-89c2-4b90-a548-979ad85f26a4 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:41 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9d489852-89c2-4b90-a548-979ad85f26a4 Nov 03 08:23:41 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:41 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9d489852-89c2-4b90-a548-979ad85f26a4" returned: 0 in 0.273s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:23:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.839s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-797211880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fdd57a2-9eb2-4ee6-b08c-f9329775cdd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81d587a398d04f4f80034c09f87f0f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:38Z,use_quota=True,user_id='48ec789ee9e74f3ab3a16fb19a19e1de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:23:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Creating volume 6fdd57a2-9eb2-4ee6-b08c-f9329775cdd2 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:23:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:23:41 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:23:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6fdd57a2-9eb2-4ee6-b08c-f9329775cdd2 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:41 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d605944-7799-47ab-b53e-95728c9930c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d489852-89c2-4b90-a548-979ad85f26a4', 'volume_size': 2}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:41 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6fdd57a2-9eb2-4ee6-b08c-f9329775cdd2 1073741824 Nov 03 08:23:41 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:41 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b275854-d615-461b-a813-c2c35c5c686e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:41 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Volume volume-9d489852-89c2-4b90-a548-979ad85f26a4 (9d489852-89c2-4b90-a548-979ad85f26a4): created successfully Nov 03 08:23:41 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b275854-d615-461b-a813-c2c35c5c686e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:41 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Flow 'volume_create_manager' (4b5d852d-6734-4d85-b390-20852634771e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:41 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-57ba2eec-7472-473d-9e85-bb0f1a2873e4 tempest-VolumesCloneNegativeTest-1045496233 None] Created volume successfully. Nov 03 08:23:41 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6fdd57a2-9eb2-4ee6-b08c-f9329775cdd2 1073741824" returned: 0 in 0.508s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6fdd57a2-9eb2-4ee6-b08c-f9329775cdd2 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:42 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6fdd57a2-9eb2-4ee6-b08c-f9329775cdd2 Nov 03 08:23:42 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4899b902-0255-4553-9588-b1e044a2c2d7 tempest-VolumesActionsTest-383491166 None] Acquiring lock "cinder-c82d4837-1606-4b56-8139-146ee99aa1d4" by "attach_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4899b902-0255-4553-9588-b1e044a2c2d7 tempest-VolumesActionsTest-383491166 None] Lock "cinder-c82d4837-1606-4b56-8139-146ee99aa1d4" acquired by "attach_volume" :: waited 0.026s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ebe7b8b8-4077-4dba-a174-7007f979c1db tempest-VolumesCloneNegativeTest-1045496233 None] Acquiring lock "cinder-9d489852-89c2-4b90-a548-979ad85f26a4-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:42 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-4899b902-0255-4553-9588-b1e044a2c2d7 tempest-VolumesActionsTest-383491166 None] Attaching volume c82d4837-1606-4b56-8139-146ee99aa1d4 to instance ba83def2-407d-4f3b-9db5-a968c0b631c6 at mountpoint /dev/vdb on host None. Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ebe7b8b8-4077-4dba-a174-7007f979c1db tempest-VolumesCloneNegativeTest-1045496233 None] Lock "cinder-9d489852-89c2-4b90-a548-979ad85f26a4-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:42 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-4899b902-0255-4553-9588-b1e044a2c2d7 tempest-VolumesActionsTest-383491166 None] Attach volume completed successfully. Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4899b902-0255-4553-9588-b1e044a2c2d7 tempest-VolumesActionsTest-383491166 None] Lock "cinder-c82d4837-1606-4b56-8139-146ee99aa1d4" released by "attach_volume" :: held 0.171s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ebe7b8b8-4077-4dba-a174-7007f979c1db tempest-VolumesCloneNegativeTest-1045496233 None] Acquiring lock "cinder-quobyte-9d489852-89c2-4b90-a548-979ad85f26a4" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ebe7b8b8-4077-4dba-a174-7007f979c1db tempest-VolumesCloneNegativeTest-1045496233 None] Lock "cinder-quobyte-9d489852-89c2-4b90-a548-979ad85f26a4" acquired by "delete_volume" :: waited 0.019s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d50db7b-8e99-4323-a4ea-e6bf661e1704]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:23:42 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ebe7b8b8-4077-4dba-a174-7007f979c1db tempest-VolumesCloneNegativeTest-1045496233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9d489852-89c2-4b90-a548-979ad85f26a4 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6fdd57a2-9eb2-4ee6-b08c-f9329775cdd2" returned: 0 in 0.445s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.786s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-426217728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=075291ac-6241-44f8-a93e-8fe43c488c8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4800f6bd3e8e44b99bc21306568494d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:38Z,use_quota=True,user_id='6842cb1abda04912a8fa0ed42a4394d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Creating volume 075291ac-6241-44f8-a93e-8fe43c488c8b {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:23:42 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-075291ac-6241-44f8-a93e-8fe43c488c8b 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:42 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-075291ac-6241-44f8-a93e-8fe43c488c8b 1073741824 Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20da5cfd-3d6d-4ae1-91be-680e43cd7320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fdd57a2-9eb2-4ee6-b08c-f9329775cdd2', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:42 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b010ecfc-04be-47aa-966b-90ae2230dbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-45f86a34-5889-49d8-b525-2502e80ea03b tempest-VolumesActionsTest-383491166 None] Acquiring lock "cinder-c82d4837-1606-4b56-8139-146ee99aa1d4-detach_volume" by "detach_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:42 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Volume volume-6fdd57a2-9eb2-4ee6-b08c-f9329775cdd2 (6fdd57a2-9eb2-4ee6-b08c-f9329775cdd2): created successfully Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b010ecfc-04be-47aa-966b-90ae2230dbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Flow 'volume_create_manager' (1816e185-34b2-48f9-af9c-c439b2f09bc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-45f86a34-5889-49d8-b525-2502e80ea03b tempest-VolumesActionsTest-383491166 None] Lock "cinder-c82d4837-1606-4b56-8139-146ee99aa1d4-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:42 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-45f86a34-5889-49d8-b525-2502e80ea03b tempest-VolumesActionsTest-383491166 None] Detaching volume c82d4837-1606-4b56-8139-146ee99aa1d4 from instance ba83def2-407d-4f3b-9db5-a968c0b631c6. Nov 03 08:23:42 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9d489852-89c2-4b90-a548-979ad85f26a4 Nov 03 08:23:42 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:42 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-ae37fca9-b861-4990-afc8-07177bc4755c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Created volume successfully. Nov 03 08:23:42 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-45f86a34-5889-49d8-b525-2502e80ea03b tempest-VolumesActionsTest-383491166 None] Detach volume completed successfully. Nov 03 08:23:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-45f86a34-5889-49d8-b525-2502e80ea03b tempest-VolumesActionsTest-383491166 None] Lock "cinder-c82d4837-1606-4b56-8139-146ee99aa1d4-detach_volume" released by "detach_volume" :: held 0.098s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:43 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ebe7b8b8-4077-4dba-a174-7007f979c1db tempest-VolumesCloneNegativeTest-1045496233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9d489852-89c2-4b90-a548-979ad85f26a4" returned: 0 in 0.551s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ebe7b8b8-4077-4dba-a174-7007f979c1db tempest-VolumesCloneNegativeTest-1045496233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9d489852-89c2-4b90-a548-979ad85f26a4 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:43 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9d489852-89c2-4b90-a548-979ad85f26a4 Nov 03 08:23:43 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:43 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-075291ac-6241-44f8-a93e-8fe43c488c8b 1073741824" returned: 0 in 0.731s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-075291ac-6241-44f8-a93e-8fe43c488c8b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:43 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-075291ac-6241-44f8-a93e-8fe43c488c8b Nov 03 08:23:43 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:43 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ebe7b8b8-4077-4dba-a174-7007f979c1db tempest-VolumesCloneNegativeTest-1045496233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9d489852-89c2-4b90-a548-979ad85f26a4" returned: 0 in 0.360s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ebe7b8b8-4077-4dba-a174-7007f979c1db tempest-VolumesCloneNegativeTest-1045496233 None] Lock "cinder-quobyte-9d489852-89c2-4b90-a548-979ad85f26a4" released by "delete_volume" :: held 0.970s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:43 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-ebe7b8b8-4077-4dba-a174-7007f979c1db tempest-VolumesCloneNegativeTest-1045496233 None] Created reservations ['09a2508e-6dd0-4831-85bd-cd291564612e', '5095cc6e-9748-4a12-9910-58386ad37c2b', 'c26ccefd-734c-425c-b3af-c2cb2e0e7e5e', 'b54cfc83-45e7-4fdd-a1b4-1bd158bd7d95'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:23:43 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ebe7b8b8-4077-4dba-a174-7007f979c1db tempest-VolumesCloneNegativeTest-1045496233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ebe7b8b8-4077-4dba-a174-7007f979c1db tempest-VolumesCloneNegativeTest-1045496233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:43 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ebe7b8b8-4077-4dba-a174-7007f979c1db tempest-VolumesCloneNegativeTest-1045496233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:43 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ebe7b8b8-4077-4dba-a174-7007f979c1db tempest-VolumesCloneNegativeTest-1045496233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ebe7b8b8-4077-4dba-a174-7007f979c1db tempest-VolumesCloneNegativeTest-1045496233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ebe7b8b8-4077-4dba-a174-7007f979c1db tempest-VolumesCloneNegativeTest-1045496233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-075291ac-6241-44f8-a93e-8fe43c488c8b" returned: 0 in 0.419s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:43 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:23:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:43 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:23:43 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:43 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf801b0-9a02-43d2-90e5-43b9112b8563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-075291ac-6241-44f8-a93e-8fe43c488c8b', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:43 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e055170d-083c-47b5-a5a4-3dd8b8826eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:43 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Volume volume-075291ac-6241-44f8-a93e-8fe43c488c8b (075291ac-6241-44f8-a93e-8fe43c488c8b): created successfully Nov 03 08:23:43 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e055170d-083c-47b5-a5a4-3dd8b8826eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:43 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Flow 'volume_create_manager' (bf500cc5-4b54-41fe-a39c-be67a2ab1d4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:43 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-e24253f3-00b3-4432-9d35-af4fb2426104 tempest-VolumesActionsTest-286286620 None] Created volume successfully. Nov 03 08:23:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-58fd17ea-d40a-4aa5-b432-6bb51c7f087c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "cinder-6fdd57a2-9eb2-4ee6-b08c-f9329775cdd2-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-58fd17ea-d40a-4aa5-b432-6bb51c7f087c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "cinder-6fdd57a2-9eb2-4ee6-b08c-f9329775cdd2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-58fd17ea-d40a-4aa5-b432-6bb51c7f087c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "cinder-quobyte-6fdd57a2-9eb2-4ee6-b08c-f9329775cdd2" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-58fd17ea-d40a-4aa5-b432-6bb51c7f087c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "cinder-quobyte-6fdd57a2-9eb2-4ee6-b08c-f9329775cdd2" acquired by "delete_volume" :: waited 0.020s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:44 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a57a26-9b71-46fc-923a-7ccab5d384f0]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:23:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-58fd17ea-d40a-4aa5-b432-6bb51c7f087c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6fdd57a2-9eb2-4ee6-b08c-f9329775cdd2 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:44 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ebe7b8b8-4077-4dba-a174-7007f979c1db tempest-VolumesCloneNegativeTest-1045496233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.445s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:44 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-ebe7b8b8-4077-4dba-a174-7007f979c1db tempest-VolumesCloneNegativeTest-1045496233 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:23:44 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-ebe7b8b8-4077-4dba-a174-7007f979c1db tempest-VolumesCloneNegativeTest-1045496233 None] Deleted volume successfully. Nov 03 08:23:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ebe7b8b8-4077-4dba-a174-7007f979c1db tempest-VolumesCloneNegativeTest-1045496233 None] Lock "cinder-9d489852-89c2-4b90-a548-979ad85f26a4-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:44 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6fdd57a2-9eb2-4ee6-b08c-f9329775cdd2 Nov 03 08:23:44 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:44 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-58fd17ea-d40a-4aa5-b432-6bb51c7f087c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6fdd57a2-9eb2-4ee6-b08c-f9329775cdd2" returned: 0 in 0.419s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-58fd17ea-d40a-4aa5-b432-6bb51c7f087c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6fdd57a2-9eb2-4ee6-b08c-f9329775cdd2 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:44 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6fdd57a2-9eb2-4ee6-b08c-f9329775cdd2 Nov 03 08:23:44 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:44 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-58fd17ea-d40a-4aa5-b432-6bb51c7f087c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6fdd57a2-9eb2-4ee6-b08c-f9329775cdd2" returned: 0 in 0.311s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-58fd17ea-d40a-4aa5-b432-6bb51c7f087c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "cinder-quobyte-6fdd57a2-9eb2-4ee6-b08c-f9329775cdd2" released by "delete_volume" :: held 0.821s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:44 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-58fd17ea-d40a-4aa5-b432-6bb51c7f087c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Created reservations ['33f590e5-8c0c-4c7e-ac78-3ec2f500c1d7', 'aab2ed98-13ba-4b7b-800a-cd4319d4275a', '6c69ee4e-3035-4289-84b3-e282f99208a0', '8734ca72-42ba-42af-97aa-9c3c889e9413'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:23:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-58fd17ea-d40a-4aa5-b432-6bb51c7f087c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-58fd17ea-d40a-4aa5-b432-6bb51c7f087c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:45 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-58fd17ea-d40a-4aa5-b432-6bb51c7f087c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:45 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-58fd17ea-d40a-4aa5-b432-6bb51c7f087c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-58fd17ea-d40a-4aa5-b432-6bb51c7f087c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-58fd17ea-d40a-4aa5-b432-6bb51c7f087c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:45 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:23:45 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:45 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-84fe0792-7113-4509-b8e0-75db053f294b tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "cinder-215b4319-6b4c-47e1-bac0-3a5f4b37c024-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:45 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-84fe0792-7113-4509-b8e0-75db053f294b tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "cinder-215b4319-6b4c-47e1-bac0-3a5f4b37c024-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:45 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-84fe0792-7113-4509-b8e0-75db053f294b tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "cinder-quobyte-215b4319-6b4c-47e1-bac0-3a5f4b37c024" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:45 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-84fe0792-7113-4509-b8e0-75db053f294b tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "cinder-quobyte-215b4319-6b4c-47e1-bac0-3a5f4b37c024" acquired by "delete_volume" :: waited 0.035s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:45 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb250ac0-0066-4f99-b855-03cca989e6a9]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:23:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-84fe0792-7113-4509-b8e0-75db053f294b tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-215b4319-6b4c-47e1-bac0-3a5f4b37c024 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:45 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-58fd17ea-d40a-4aa5-b432-6bb51c7f087c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.462s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:45 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-58fd17ea-d40a-4aa5-b432-6bb51c7f087c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:23:45 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-58fd17ea-d40a-4aa5-b432-6bb51c7f087c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Deleted volume successfully. Nov 03 08:23:45 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-215b4319-6b4c-47e1-bac0-3a5f4b37c024 Nov 03 08:23:45 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:45 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-58fd17ea-d40a-4aa5-b432-6bb51c7f087c tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "cinder-6fdd57a2-9eb2-4ee6-b08c-f9329775cdd2-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:45 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-84fe0792-7113-4509-b8e0-75db053f294b tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-215b4319-6b4c-47e1-bac0-3a5f4b37c024" returned: 0 in 0.501s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-84fe0792-7113-4509-b8e0-75db053f294b tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-215b4319-6b4c-47e1-bac0-3a5f4b37c024 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:45 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-215b4319-6b4c-47e1-bac0-3a5f4b37c024 Nov 03 08:23:45 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:46 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-14200cca-de64-4bcb-a695-5ccb5eb4a549 tempest-VolumesActionsTest-286286620 None] Acquiring lock "cinder-075291ac-6241-44f8-a93e-8fe43c488c8b-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:46 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-14200cca-de64-4bcb-a695-5ccb5eb4a549 tempest-VolumesActionsTest-286286620 None] Lock "cinder-075291ac-6241-44f8-a93e-8fe43c488c8b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:46 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-14200cca-de64-4bcb-a695-5ccb5eb4a549 tempest-VolumesActionsTest-286286620 None] Acquiring lock "cinder-quobyte-075291ac-6241-44f8-a93e-8fe43c488c8b" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:46 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-14200cca-de64-4bcb-a695-5ccb5eb4a549 tempest-VolumesActionsTest-286286620 None] Lock "cinder-quobyte-075291ac-6241-44f8-a93e-8fe43c488c8b" acquired by "delete_volume" :: waited 0.026s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:46 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-84fe0792-7113-4509-b8e0-75db053f294b tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-215b4319-6b4c-47e1-bac0-3a5f4b37c024" returned: 0 in 0.405s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:46 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-84fe0792-7113-4509-b8e0-75db053f294b tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "cinder-quobyte-215b4319-6b4c-47e1-bac0-3a5f4b37c024" released by "delete_volume" :: held 0.989s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:46 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[d301711e-a07e-481c-aac9-1b1597904cf9]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:23:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-14200cca-de64-4bcb-a695-5ccb5eb4a549 tempest-VolumesActionsTest-286286620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-075291ac-6241-44f8-a93e-8fe43c488c8b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:46 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-84fe0792-7113-4509-b8e0-75db053f294b tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Created reservations ['d4dcabd0-bc76-40e7-a83b-52ef62f30a9c', '1ee1bbed-a710-4b4d-80b2-ecfb4af2d0ad', '45e29a34-c2d7-4e74-9d9e-454ff130ea64', '7a991701-fd50-49e9-bc61-a3a7e6d07043'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:23:46 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-075291ac-6241-44f8-a93e-8fe43c488c8b Nov 03 08:23:46 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-84fe0792-7113-4509-b8e0-75db053f294b tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-84fe0792-7113-4509-b8e0-75db053f294b tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-84fe0792-7113-4509-b8e0-75db053f294b tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-84fe0792-7113-4509-b8e0-75db053f294b tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-84fe0792-7113-4509-b8e0-75db053f294b tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-84fe0792-7113-4509-b8e0-75db053f294b tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:46 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:23:46 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:46 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-84fe0792-7113-4509-b8e0-75db053f294b tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.313s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:46 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-84fe0792-7113-4509-b8e0-75db053f294b tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:23:46 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-84fe0792-7113-4509-b8e0-75db053f294b tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Deleted volume successfully. Nov 03 08:23:46 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-14200cca-de64-4bcb-a695-5ccb5eb4a549 tempest-VolumesActionsTest-286286620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-075291ac-6241-44f8-a93e-8fe43c488c8b" returned: 0 in 0.557s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-14200cca-de64-4bcb-a695-5ccb5eb4a549 tempest-VolumesActionsTest-286286620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-075291ac-6241-44f8-a93e-8fe43c488c8b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:46 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-84fe0792-7113-4509-b8e0-75db053f294b tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "cinder-215b4319-6b4c-47e1-bac0-3a5f4b37c024-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:46 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-075291ac-6241-44f8-a93e-8fe43c488c8b Nov 03 08:23:46 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:47 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-14200cca-de64-4bcb-a695-5ccb5eb4a549 tempest-VolumesActionsTest-286286620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-075291ac-6241-44f8-a93e-8fe43c488c8b" returned: 0 in 0.309s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-14200cca-de64-4bcb-a695-5ccb5eb4a549 tempest-VolumesActionsTest-286286620 None] Lock "cinder-quobyte-075291ac-6241-44f8-a93e-8fe43c488c8b" released by "delete_volume" :: held 0.939s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:47 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-14200cca-de64-4bcb-a695-5ccb5eb4a549 tempest-VolumesActionsTest-286286620 None] Created reservations ['ec641394-ad73-477f-bb49-4c4fb3cc64a5', 'e10b10b9-4d63-4b45-a7fb-13aaf0d11858', '2d26c878-6da9-4dac-9f9c-65d385d9f224', '7cc5ad3a-15d9-4b5d-ba70-c29af48e1660'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:23:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-14200cca-de64-4bcb-a695-5ccb5eb4a549 tempest-VolumesActionsTest-286286620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-14200cca-de64-4bcb-a695-5ccb5eb4a549 tempest-VolumesActionsTest-286286620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:47 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-14200cca-de64-4bcb-a695-5ccb5eb4a549 tempest-VolumesActionsTest-286286620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:47 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-14200cca-de64-4bcb-a695-5ccb5eb4a549 tempest-VolumesActionsTest-286286620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-14200cca-de64-4bcb-a695-5ccb5eb4a549 tempest-VolumesActionsTest-286286620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-14200cca-de64-4bcb-a695-5ccb5eb4a549 tempest-VolumesActionsTest-286286620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:47 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:23:47 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c5045f75-7f7b-441a-9b5e-048eb1871122 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "cinder-f7264815-9c8e-4fb1-91fd-7d5064040b6d-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c5045f75-7f7b-441a-9b5e-048eb1871122 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "cinder-f7264815-9c8e-4fb1-91fd-7d5064040b6d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:47 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-14200cca-de64-4bcb-a695-5ccb5eb4a549 tempest-VolumesActionsTest-286286620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.291s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:47 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-14200cca-de64-4bcb-a695-5ccb5eb4a549 tempest-VolumesActionsTest-286286620 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:23:47 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-14200cca-de64-4bcb-a695-5ccb5eb4a549 tempest-VolumesActionsTest-286286620 None] Deleted volume successfully. Nov 03 08:23:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c5045f75-7f7b-441a-9b5e-048eb1871122 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "cinder-quobyte-f7264815-9c8e-4fb1-91fd-7d5064040b6d" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-14200cca-de64-4bcb-a695-5ccb5eb4a549 tempest-VolumesActionsTest-286286620 None] Lock "cinder-075291ac-6241-44f8-a93e-8fe43c488c8b-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c5045f75-7f7b-441a-9b5e-048eb1871122 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "cinder-quobyte-f7264815-9c8e-4fb1-91fd-7d5064040b6d" acquired by "delete_volume" :: waited 0.024s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:47 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ebd8ee-aec0-4c95-8f08-0ac94f860f00]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:23:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c5045f75-7f7b-441a-9b5e-048eb1871122 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7264815-9c8e-4fb1-91fd-7d5064040b6d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:47 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7264815-9c8e-4fb1-91fd-7d5064040b6d Nov 03 08:23:47 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:48 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c5045f75-7f7b-441a-9b5e-048eb1871122 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7264815-9c8e-4fb1-91fd-7d5064040b6d" returned: 0 in 0.503s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c5045f75-7f7b-441a-9b5e-048eb1871122 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7264815-9c8e-4fb1-91fd-7d5064040b6d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:48 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7264815-9c8e-4fb1-91fd-7d5064040b6d Nov 03 08:23:48 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:48 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c5045f75-7f7b-441a-9b5e-048eb1871122 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f7264815-9c8e-4fb1-91fd-7d5064040b6d" returned: 0 in 0.340s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:48 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c5045f75-7f7b-441a-9b5e-048eb1871122 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "cinder-quobyte-f7264815-9c8e-4fb1-91fd-7d5064040b6d" released by "delete_volume" :: held 0.899s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:48 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-c5045f75-7f7b-441a-9b5e-048eb1871122 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Created reservations ['4bfe839d-ba40-4685-963b-5e089d91c589', 'ca43f166-c788-4bb3-b798-2e679310592f', 'b437b5a1-42d0-422a-b92d-f49a978c97de', 'f925f04b-7fab-4d96-8439-eed07e36b419'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:23:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c5045f75-7f7b-441a-9b5e-048eb1871122 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c5045f75-7f7b-441a-9b5e-048eb1871122 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c5045f75-7f7b-441a-9b5e-048eb1871122 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c5045f75-7f7b-441a-9b5e-048eb1871122 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c5045f75-7f7b-441a-9b5e-048eb1871122 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c5045f75-7f7b-441a-9b5e-048eb1871122 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:48 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:23:48 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:48 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-2fd188c4-f626-4d8d-9ada-06a5e7b6a3f7 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "cinder-c68aaa7e-19f5-46ab-a193-6e23807b0a16-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:49 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-2fd188c4-f626-4d8d-9ada-06a5e7b6a3f7 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "cinder-c68aaa7e-19f5-46ab-a193-6e23807b0a16-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:49 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-2fd188c4-f626-4d8d-9ada-06a5e7b6a3f7 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "cinder-quobyte-c68aaa7e-19f5-46ab-a193-6e23807b0a16" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:49 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-2fd188c4-f626-4d8d-9ada-06a5e7b6a3f7 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "cinder-quobyte-c68aaa7e-19f5-46ab-a193-6e23807b0a16" acquired by "delete_volume" :: waited 0.030s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:49 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[7212a6db-025d-46e3-b677-bd328c566be9]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:23:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2fd188c4-f626-4d8d-9ada-06a5e7b6a3f7 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c68aaa7e-19f5-46ab-a193-6e23807b0a16 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:49 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c68aaa7e-19f5-46ab-a193-6e23807b0a16 Nov 03 08:23:49 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:49 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c5045f75-7f7b-441a-9b5e-048eb1871122 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.589s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:49 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-c5045f75-7f7b-441a-9b5e-048eb1871122 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:23:49 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-c5045f75-7f7b-441a-9b5e-048eb1871122 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Deleted volume successfully. Nov 03 08:23:49 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c5045f75-7f7b-441a-9b5e-048eb1871122 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "cinder-f7264815-9c8e-4fb1-91fd-7d5064040b6d-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:49 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2fd188c4-f626-4d8d-9ada-06a5e7b6a3f7 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c68aaa7e-19f5-46ab-a193-6e23807b0a16" returned: 0 in 0.783s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2fd188c4-f626-4d8d-9ada-06a5e7b6a3f7 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c68aaa7e-19f5-46ab-a193-6e23807b0a16 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:50 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c68aaa7e-19f5-46ab-a193-6e23807b0a16 Nov 03 08:23:50 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Flow 'volume_create_manager' (452b2c51-5de8-4954-8bae-9e12b51e852d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17b302a-ea41-4381-ae96-32e042cd0821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17b302a-ea41-4381-ae96-32e042cd0821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-342662573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73790bbc-0e56-4a9e-b87f-b9668f135225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec0a72d8527f4b1e9d44721bd78179f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:50Z,use_quota=True,user_id='e0bb09f52f7048aaa571ecfcca793b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ffa0ac-494a-4809-9c00-c4693425719f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ffa0ac-494a-4809-9c00-c4693425719f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d16083f5-8602-4cd6-9eaf-063c7c6cc084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:50 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d16083f5-8602-4cd6-9eaf-063c7c6cc084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73790bbc-0e56-4a9e-b87f-b9668f135225', 'volume_name': 'volume-73790bbc-0e56-4a9e-b87f-b9668f135225', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (960685cc-7c98-4131-bc83-226d64cb230d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (960685cc-7c98-4131-bc83-226d64cb230d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a21620ec-ad51-4cd0-9fef-6afb2ce1321c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:50 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Volume 73790bbc-0e56-4a9e-b87f-b9668f135225: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73790bbc-0e56-4a9e-b87f-b9668f135225', 'volume_size': 1} Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-342662573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73790bbc-0e56-4a9e-b87f-b9668f135225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec0a72d8527f4b1e9d44721bd78179f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:23:50Z,use_quota=True,user_id='e0bb09f52f7048aaa571ecfcca793b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Creating volume 73790bbc-0e56-4a9e-b87f-b9668f135225 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:23:50 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2fd188c4-f626-4d8d-9ada-06a5e7b6a3f7 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c68aaa7e-19f5-46ab-a193-6e23807b0a16" returned: 0 in 0.476s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-2fd188c4-f626-4d8d-9ada-06a5e7b6a3f7 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "cinder-quobyte-c68aaa7e-19f5-46ab-a193-6e23807b0a16" released by "delete_volume" :: held 1.351s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:50 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225 1073741824 Nov 03 08:23:50 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-2fd188c4-f626-4d8d-9ada-06a5e7b6a3f7 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Created reservations ['6a3153c4-c36c-4c2a-b7ed-0bb6c6ff8894', 'd6d4947c-318d-4a47-b6eb-e38cdadea96e', '980a7968-8c7d-4323-8e3b-ab7e63c1c103', '4250d6b3-e7b2-418e-b21a-16f2a5e1f292'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2fd188c4-f626-4d8d-9ada-06a5e7b6a3f7 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2fd188c4-f626-4d8d-9ada-06a5e7b6a3f7 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2fd188c4-f626-4d8d-9ada-06a5e7b6a3f7 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2fd188c4-f626-4d8d-9ada-06a5e7b6a3f7 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2fd188c4-f626-4d8d-9ada-06a5e7b6a3f7 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2fd188c4-f626-4d8d-9ada-06a5e7b6a3f7 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:50 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:23:50 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:50 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2fd188c4-f626-4d8d-9ada-06a5e7b6a3f7 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.332s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:50 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-2fd188c4-f626-4d8d-9ada-06a5e7b6a3f7 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:23:50 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-2fd188c4-f626-4d8d-9ada-06a5e7b6a3f7 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Deleted volume successfully. Nov 03 08:23:51 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-2fd188c4-f626-4d8d-9ada-06a5e7b6a3f7 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "cinder-c68aaa7e-19f5-46ab-a193-6e23807b0a16-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:51 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225 1073741824" returned: 0 in 0.590s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:51 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225 Nov 03 08:23:51 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:51 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225" returned: 0 in 0.272s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:51 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:23:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a21620ec-ad51-4cd0-9fef-6afb2ce1321c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73790bbc-0e56-4a9e-b87f-b9668f135225', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31866b1d-0ea1-4515-95a7-cca9d940c600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:23:51 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5d475433-9fe4-4be0-a469-00f2c44f3166 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "cinder-6193f217-9bf7-4f2f-b714-3eba043cc7a5-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:51 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Volume volume-73790bbc-0e56-4a9e-b87f-b9668f135225 (73790bbc-0e56-4a9e-b87f-b9668f135225): created successfully Nov 03 08:23:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31866b1d-0ea1-4515-95a7-cca9d940c600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:23:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Flow 'volume_create_manager' (452b2c51-5de8-4954-8bae-9e12b51e852d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:23:51 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-8902fac9-da2e-45eb-8c3f-fe98d5f4908e tempest-VolumesSnapshotListTestJSON-104002281 None] Created volume successfully. Nov 03 08:23:51 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5d475433-9fe4-4be0-a469-00f2c44f3166 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "cinder-6193f217-9bf7-4f2f-b714-3eba043cc7a5-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:51 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5d475433-9fe4-4be0-a469-00f2c44f3166 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "cinder-quobyte-6193f217-9bf7-4f2f-b714-3eba043cc7a5" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:51 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5d475433-9fe4-4be0-a469-00f2c44f3166 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "cinder-quobyte-6193f217-9bf7-4f2f-b714-3eba043cc7a5" acquired by "delete_volume" :: waited 0.030s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:51 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[118eb068-d020-4d70-8404-5e8eeab29b40]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:23:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5d475433-9fe4-4be0-a469-00f2c44f3166 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6193f217-9bf7-4f2f-b714-3eba043cc7a5 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:51 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6193f217-9bf7-4f2f-b714-3eba043cc7a5 Nov 03 08:23:51 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:51 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5d475433-9fe4-4be0-a469-00f2c44f3166 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6193f217-9bf7-4f2f-b714-3eba043cc7a5" returned: 0 in 0.395s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5d475433-9fe4-4be0-a469-00f2c44f3166 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6193f217-9bf7-4f2f-b714-3eba043cc7a5 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:51 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6193f217-9bf7-4f2f-b714-3eba043cc7a5 Nov 03 08:23:51 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:52 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5d475433-9fe4-4be0-a469-00f2c44f3166 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6193f217-9bf7-4f2f-b714-3eba043cc7a5" returned: 0 in 0.386s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:52 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5d475433-9fe4-4be0-a469-00f2c44f3166 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "cinder-quobyte-6193f217-9bf7-4f2f-b714-3eba043cc7a5" released by "delete_volume" :: held 0.842s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:52 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-5d475433-9fe4-4be0-a469-00f2c44f3166 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Created reservations ['b77ff1a0-cfa8-4c54-b54a-b10c2bea2347', 'a8d3b2a2-adac-4a77-ad45-47cf2443ea14', '3dc9a6f9-e699-4fd5-86cd-1915575f154a', '97aa41a1-939e-45cb-b9e7-cc3fc204056e'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:23:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5d475433-9fe4-4be0-a469-00f2c44f3166 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5d475433-9fe4-4be0-a469-00f2c44f3166 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:52 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5d475433-9fe4-4be0-a469-00f2c44f3166 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:52 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5d475433-9fe4-4be0-a469-00f2c44f3166 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5d475433-9fe4-4be0-a469-00f2c44f3166 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5d475433-9fe4-4be0-a469-00f2c44f3166 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e98d1358-5287-4ad1-819c-2adf393eff9a tempest-VolumesSnapshotListTestJSON-104002281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e98d1358-5287-4ad1-819c-2adf393eff9a tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:52 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:23:52 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:52 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-e98d1358-5287-4ad1-819c-2adf393eff9a tempest-VolumesSnapshotListTestJSON-104002281 None] Creating offline snapshot dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b of volume 73790bbc-0e56-4a9e-b87f-b9668f135225 {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:23:52 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e488b046-b1e7-4809-86d8-050468b42c33 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "cinder-a968c4f0-fe4f-4a30-884d-7de08f5aeac7-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:52 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e488b046-b1e7-4809-86d8-050468b42c33 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "cinder-a968c4f0-fe4f-4a30-884d-7de08f5aeac7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:52 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[56680ff1-4f42-442b-bd28-dc837385ee0f]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:23:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e98d1358-5287-4ad1-819c-2adf393eff9a tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:52 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e488b046-b1e7-4809-86d8-050468b42c33 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "cinder-quobyte-a968c4f0-fe4f-4a30-884d-7de08f5aeac7" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:52 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e488b046-b1e7-4809-86d8-050468b42c33 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "cinder-quobyte-a968c4f0-fe4f-4a30-884d-7de08f5aeac7" acquired by "delete_volume" :: waited 0.025s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:52 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225 Nov 03 08:23:52 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:52 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0e6574-76d4-4c8d-9c88-6b0625f765c1]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:23:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e488b046-b1e7-4809-86d8-050468b42c33 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a968c4f0-fe4f-4a30-884d-7de08f5aeac7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:52 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5d475433-9fe4-4be0-a469-00f2c44f3166 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.420s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:52 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-5d475433-9fe4-4be0-a469-00f2c44f3166 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:23:52 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-5d475433-9fe4-4be0-a469-00f2c44f3166 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Deleted volume successfully. Nov 03 08:23:53 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5d475433-9fe4-4be0-a469-00f2c44f3166 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "cinder-6193f217-9bf7-4f2f-b714-3eba043cc7a5-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:53 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a968c4f0-fe4f-4a30-884d-7de08f5aeac7 Nov 03 08:23:53 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:53 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e98d1358-5287-4ad1-819c-2adf393eff9a tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225" returned: 0 in 0.762s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e98d1358-5287-4ad1-819c-2adf393eff9a tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:53 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b 1G Nov 03 08:23:53 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:53 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e488b046-b1e7-4809-86d8-050468b42c33 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a968c4f0-fe4f-4a30-884d-7de08f5aeac7" returned: 0 in 0.971s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e488b046-b1e7-4809-86d8-050468b42c33 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a968c4f0-fe4f-4a30-884d-7de08f5aeac7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:53 devstack sudo[97936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a968c4f0-fe4f-4a30-884d-7de08f5aeac7 Nov 03 08:23:53 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:54 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e488b046-b1e7-4809-86d8-050468b42c33 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a968c4f0-fe4f-4a30-884d-7de08f5aeac7" returned: 0 in 0.610s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:54 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e488b046-b1e7-4809-86d8-050468b42c33 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "cinder-quobyte-a968c4f0-fe4f-4a30-884d-7de08f5aeac7" released by "delete_volume" :: held 1.670s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:54 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e98d1358-5287-4ad1-819c-2adf393eff9a tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b 1G" returned: 0 in 1.099s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e98d1358-5287-4ad1-819c-2adf393eff9a tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73790bbc-0e56-4a9e-b87f-b9668f135225 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:54 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-e488b046-b1e7-4809-86d8-050468b42c33 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Created reservations ['a261c375-0267-4f2a-96b3-d4a621137ea4', 'a2cb4260-bb71-4d2b-8b8a-d3e781c6eec8', 'd452ceed-0059-4a84-ab21-858a2063b149', '29cfc062-738e-47e6-aaa7-043a71888e38'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:23:54 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73790bbc-0e56-4a9e-b87f-b9668f135225 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b Nov 03 08:23:54 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e488b046-b1e7-4809-86d8-050468b42c33 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e488b046-b1e7-4809-86d8-050468b42c33 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e488b046-b1e7-4809-86d8-050468b42c33 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:23:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e488b046-b1e7-4809-86d8-050468b42c33 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:23:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e488b046-b1e7-4809-86d8-050468b42c33 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e488b046-b1e7-4809-86d8-050468b42c33 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:54 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:23:54 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:55 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e98d1358-5287-4ad1-819c-2adf393eff9a tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73790bbc-0e56-4a9e-b87f-b9668f135225 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b" returned: 0 in 0.761s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:55 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-e98d1358-5287-4ad1-819c-2adf393eff9a tempest-VolumesSnapshotListTestJSON-104002281 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b is being set with open permissions: ugo+rw Nov 03 08:23:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e98d1358-5287-4ad1-819c-2adf393eff9a tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:55 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b Nov 03 08:23:55 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:55 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e488b046-b1e7-4809-86d8-050468b42c33 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.749s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:55 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-e488b046-b1e7-4809-86d8-050468b42c33 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:23:55 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-e488b046-b1e7-4809-86d8-050468b42c33 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Deleted volume successfully. Nov 03 08:23:55 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e488b046-b1e7-4809-86d8-050468b42c33 tempest-CreateVolumesFromSourceVolumeTest-1372314921 None] Lock "cinder-a968c4f0-fe4f-4a30-884d-7de08f5aeac7-delete_volume" released by "delete_volume" :: held 2.937s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:56 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e98d1358-5287-4ad1-819c-2adf393eff9a tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b" returned: 0 in 0.857s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:56 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=154,cinder:INSERT=52,cinder:DELETE=25,cinder:UPDATE=198 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:23:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e98d1358-5287-4ad1-819c-2adf393eff9a tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:56 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.info Nov 03 08:23:56 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:56 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e98d1358-5287-4ad1-819c-2adf393eff9a tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.info" returned: 0 in 0.449s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:56 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-e98d1358-5287-4ad1-819c-2adf393eff9a tempest-VolumesSnapshotListTestJSON-104002281 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.info is being set with open permissions: ugo+rw Nov 03 08:23:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e98d1358-5287-4ad1-819c-2adf393eff9a tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:56 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.info Nov 03 08:23:56 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:57 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e98d1358-5287-4ad1-819c-2adf393eff9a tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.info" returned: 0 in 0.436s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e98d1358-5287-4ad1-819c-2adf393eff9a tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.567s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:23:57 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-e98d1358-5287-4ad1-819c-2adf393eff9a tempest-VolumesSnapshotListTestJSON-104002281 None] Create snapshot completed successfully Nov 03 08:23:57 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-95345d96-b8d2-4833-86c5-8f64f5dacb11 tempest-VolumesActionsTest-383491166 None] Acquiring lock "cinder-c82d4837-1606-4b56-8139-146ee99aa1d4" by "attach_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:57 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-95345d96-b8d2-4833-86c5-8f64f5dacb11 tempest-VolumesActionsTest-383491166 None] Lock "cinder-c82d4837-1606-4b56-8139-146ee99aa1d4" acquired by "attach_volume" :: waited 0.040s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:57 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:UPDATE=224,cinder:SELECT=146,cinder:INSERT=47,cinder:DELETE=11 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:23:58 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-95345d96-b8d2-4833-86c5-8f64f5dacb11 tempest-VolumesActionsTest-383491166 None] Attaching volume c82d4837-1606-4b56-8139-146ee99aa1d4 to instance c4c9c232-a54c-4110-b92a-6dca0fdf9737 at mountpoint /dev/vdb on host None. Nov 03 08:23:58 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-95345d96-b8d2-4833-86c5-8f64f5dacb11 tempest-VolumesActionsTest-383491166 None] Attach volume completed successfully. Nov 03 08:23:58 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-95345d96-b8d2-4833-86c5-8f64f5dacb11 tempest-VolumesActionsTest-383491166 None] Lock "cinder-c82d4837-1606-4b56-8139-146ee99aa1d4" released by "attach_volume" :: held 0.207s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a2e148ca-6637-4c3c-ad7c-3b693bf93830 tempest-VolumesSnapshotListTestJSON-104002281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:23:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a2e148ca-6637-4c3c-ad7c-3b693bf93830 tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:23:58 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-a2e148ca-6637-4c3c-ad7c-3b693bf93830 tempest-VolumesSnapshotListTestJSON-104002281 None] Creating offline snapshot 5cdfbda4-207c-43c4-9e5f-1ac04763aae7 of volume 73790bbc-0e56-4a9e-b87f-b9668f135225 {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:23:58 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e741439-70ee-4f20-92fa-028c6d051efc]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:23:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a2e148ca-6637-4c3c-ad7c-3b693bf93830 tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:58 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b Nov 03 08:23:58 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:58 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-41915262-e154-400b-aec0-6dc9227d1a70 tempest-VolumesActionsTest-383491166 None] Acquiring lock "cinder-c82d4837-1606-4b56-8139-146ee99aa1d4-detach_volume" by "detach_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:23:59 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-41915262-e154-400b-aec0-6dc9227d1a70 tempest-VolumesActionsTest-383491166 None] Lock "cinder-c82d4837-1606-4b56-8139-146ee99aa1d4-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:23:59 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-41915262-e154-400b-aec0-6dc9227d1a70 tempest-VolumesActionsTest-383491166 None] Detaching volume c82d4837-1606-4b56-8139-146ee99aa1d4 from instance c4c9c232-a54c-4110-b92a-6dca0fdf9737. Nov 03 08:23:59 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a2e148ca-6637-4c3c-ad7c-3b693bf93830 tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b" returned: 0 in 0.587s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:59 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-a2e148ca-6637-4c3c-ad7c-3b693bf93830 tempest-VolumesSnapshotListTestJSON-104002281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73790bbc-0e56-4a9e-b87f-b9668f135225(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:23:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a2e148ca-6637-4c3c-ad7c-3b693bf93830 tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:59 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7 1G Nov 03 08:23:59 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:23:59 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-41915262-e154-400b-aec0-6dc9227d1a70 tempest-VolumesActionsTest-383491166 None] Detach volume completed successfully. Nov 03 08:23:59 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-41915262-e154-400b-aec0-6dc9227d1a70 tempest-VolumesActionsTest-383491166 None] Lock "cinder-c82d4837-1606-4b56-8139-146ee99aa1d4-detach_volume" released by "detach_volume" :: held 0.186s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:23:59 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Nov 03 08:23:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a2e148ca-6637-4c3c-ad7c-3b693bf93830 tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7 1G" returned: 0 in 0.729s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:23:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a2e148ca-6637-4c3c-ad7c-3b693bf93830 tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:23:59 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7 Nov 03 08:23:59 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:00 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a2e148ca-6637-4c3c-ad7c-3b693bf93830 tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7" returned: 0 in 0.541s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:00 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-a2e148ca-6637-4c3c-ad7c-3b693bf93830 tempest-VolumesSnapshotListTestJSON-104002281 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7 is being set with open permissions: ugo+rw Nov 03 08:24:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a2e148ca-6637-4c3c-ad7c-3b693bf93830 tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:00 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7 Nov 03 08:24:00 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:00 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a2e148ca-6637-4c3c-ad7c-3b693bf93830 tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7" returned: 0 in 0.331s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a2e148ca-6637-4c3c-ad7c-3b693bf93830 tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.390s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:24:00 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-a2e148ca-6637-4c3c-ad7c-3b693bf93830 tempest-VolumesSnapshotListTestJSON-104002281 None] Create snapshot completed successfully Nov 03 08:24:01 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:24:01 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Flow 'volume_create_manager' (33dce576-9adf-446c-939d-d3c11e7bc32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:24:01 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b3158a-6fe5-486e-aeb2-73bb1163287f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:01 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b3158a-6fe5-486e-aeb2-73bb1163287f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1117412657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d648b5c9-f054-4cf3-bd8d-62b3adaa16b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b97e114fa9c4cf7b4003d9889bb98cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:24:01Z,use_quota=True,user_id='04dde37bd9834bb59abd27fcf08c4914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:01 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c96586-71da-4138-8cfa-f1d53ffb5aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:01 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c96586-71da-4138-8cfa-f1d53ffb5aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:01 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a949fb-2ac2-46da-a96f-42c5d292831e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:01 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a949fb-2ac2-46da-a96f-42c5d292831e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd648b5c9-f054-4cf3-bd8d-62b3adaa16b4', 'volume_name': 'volume-d648b5c9-f054-4cf3-bd8d-62b3adaa16b4', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:01 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99fb21c0-963a-4557-a007-496fea030dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:01 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99fb21c0-963a-4557-a007-496fea030dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:01 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (752c4091-1bca-4ae6-b97b-4b265963f121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:01 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Volume d648b5c9-f054-4cf3-bd8d-62b3adaa16b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d648b5c9-f054-4cf3-bd8d-62b3adaa16b4', 'volume_size': 1} Nov 03 08:24:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:24:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:24:01 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1117412657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d648b5c9-f054-4cf3-bd8d-62b3adaa16b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b97e114fa9c4cf7b4003d9889bb98cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:24:01Z,use_quota=True,user_id='04dde37bd9834bb59abd27fcf08c4914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:24:01 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Creating volume d648b5c9-f054-4cf3-bd8d-62b3adaa16b4 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:24:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:24:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:24:01 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:24:01 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:24:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:24:01 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:24:01 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:24:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d648b5c9-f054-4cf3-bd8d-62b3adaa16b4 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:01 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d648b5c9-f054-4cf3-bd8d-62b3adaa16b4 1073741824 Nov 03 08:24:01 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-cef11911-82f6-45d8-8373-b85278af5856 tempest-VolumesSnapshotListTestJSON-104002281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:24:02 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d648b5c9-f054-4cf3-bd8d-62b3adaa16b4 1073741824" returned: 0 in 0.521s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d648b5c9-f054-4cf3-bd8d-62b3adaa16b4 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:02 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d648b5c9-f054-4cf3-bd8d-62b3adaa16b4 Nov 03 08:24:02 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:02 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d648b5c9-f054-4cf3-bd8d-62b3adaa16b4" returned: 0 in 0.256s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:02 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:24:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:24:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-cef11911-82f6-45d8-8373-b85278af5856 tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.555s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:24:02 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (752c4091-1bca-4ae6-b97b-4b265963f121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d648b5c9-f054-4cf3-bd8d-62b3adaa16b4', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:02 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeee89ee-3366-4b32-aa15-dab41aa434c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:02 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-cef11911-82f6-45d8-8373-b85278af5856 tempest-VolumesSnapshotListTestJSON-104002281 None] Creating offline snapshot 3b85f7fc-c478-4a4f-a0d9-5313cc9e6889 of volume 73790bbc-0e56-4a9e-b87f-b9668f135225 {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:24:02 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Volume volume-d648b5c9-f054-4cf3-bd8d-62b3adaa16b4 (d648b5c9-f054-4cf3-bd8d-62b3adaa16b4): created successfully Nov 03 08:24:02 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeee89ee-3366-4b32-aa15-dab41aa434c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:02 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Flow 'volume_create_manager' (33dce576-9adf-446c-939d-d3c11e7bc32f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:24:02 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a1a53b-9916-4ddb-9676-2cda7380669e]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:24:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-cef11911-82f6-45d8-8373-b85278af5856 tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:02 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-fe9654d0-f1a9-4a7f-b83c-083ea14632aa tempest-ProjectReaderTests-117322171 None] Created volume successfully. Nov 03 08:24:02 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7 Nov 03 08:24:02 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:02 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-cef11911-82f6-45d8-8373-b85278af5856 tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7" returned: 0 in 0.420s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:02 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-cef11911-82f6-45d8-8373-b85278af5856 tempest-VolumesSnapshotListTestJSON-104002281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73790bbc-0e56-4a9e-b87f-b9668f135225(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:24:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-cef11911-82f6-45d8-8373-b85278af5856 tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.3b85f7fc-c478-4a4f-a0d9-5313cc9e6889 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:02 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.3b85f7fc-c478-4a4f-a0d9-5313cc9e6889 1G Nov 03 08:24:03 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:03 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-cef11911-82f6-45d8-8373-b85278af5856 tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.3b85f7fc-c478-4a4f-a0d9-5313cc9e6889 1G" returned: 0 in 0.615s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-cef11911-82f6-45d8-8373-b85278af5856 tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.3b85f7fc-c478-4a4f-a0d9-5313cc9e6889 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:03 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.3b85f7fc-c478-4a4f-a0d9-5313cc9e6889 Nov 03 08:24:03 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b3b82406-78fa-440b-8bc3-4a5dfee4b2b3 tempest-ProjectReaderTests-117322171 None] Acquiring lock "cinder-d648b5c9-f054-4cf3-bd8d-62b3adaa16b4-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:24:03 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:24:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:24:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:24:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:24:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:24:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:24:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:03 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:24:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b3b82406-78fa-440b-8bc3-4a5dfee4b2b3 tempest-ProjectReaderTests-117322171 None] Lock "cinder-d648b5c9-f054-4cf3-bd8d-62b3adaa16b4-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:24:03 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b3b82406-78fa-440b-8bc3-4a5dfee4b2b3 tempest-ProjectReaderTests-117322171 None] Acquiring lock "cinder-quobyte-d648b5c9-f054-4cf3-bd8d-62b3adaa16b4" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:24:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b3b82406-78fa-440b-8bc3-4a5dfee4b2b3 tempest-ProjectReaderTests-117322171 None] Lock "cinder-quobyte-d648b5c9-f054-4cf3-bd8d-62b3adaa16b4" acquired by "delete_volume" :: waited 0.019s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:24:03 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[26904552-63d0-42e2-bcc7-594ce006bd47]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:24:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b3b82406-78fa-440b-8bc3-4a5dfee4b2b3 tempest-ProjectReaderTests-117322171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d648b5c9-f054-4cf3-bd8d-62b3adaa16b4 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:04 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.323s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:04 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:24:04 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager._thread_info {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:24:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread count: 29 {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 08:24:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread info: [<_MainThread(MainThread, started 139707544170624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 08:24:04 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d648b5c9-f054-4cf3-bd8d-62b3adaa16b4 Nov 03 08:24:04 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:04 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-cef11911-82f6-45d8-8373-b85278af5856 tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.3b85f7fc-c478-4a4f-a0d9-5313cc9e6889" returned: 0 in 0.496s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:04 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-cef11911-82f6-45d8-8373-b85278af5856 tempest-VolumesSnapshotListTestJSON-104002281 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.3b85f7fc-c478-4a4f-a0d9-5313cc9e6889 is being set with open permissions: ugo+rw Nov 03 08:24:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-cef11911-82f6-45d8-8373-b85278af5856 tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.3b85f7fc-c478-4a4f-a0d9-5313cc9e6889 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:04 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.3b85f7fc-c478-4a4f-a0d9-5313cc9e6889 Nov 03 08:24:04 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:04 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-cef11911-82f6-45d8-8373-b85278af5856 tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.3b85f7fc-c478-4a4f-a0d9-5313cc9e6889" returned: 0 in 0.298s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:04 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b3b82406-78fa-440b-8bc3-4a5dfee4b2b3 tempest-ProjectReaderTests-117322171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d648b5c9-f054-4cf3-bd8d-62b3adaa16b4" returned: 0 in 0.477s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b3b82406-78fa-440b-8bc3-4a5dfee4b2b3 tempest-ProjectReaderTests-117322171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d648b5c9-f054-4cf3-bd8d-62b3adaa16b4 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:04 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d648b5c9-f054-4cf3-bd8d-62b3adaa16b4 Nov 03 08:24:04 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-cef11911-82f6-45d8-8373-b85278af5856 tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.071s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:24:04 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-cef11911-82f6-45d8-8373-b85278af5856 tempest-VolumesSnapshotListTestJSON-104002281 None] Create snapshot completed successfully Nov 03 08:24:04 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b3b82406-78fa-440b-8bc3-4a5dfee4b2b3 tempest-ProjectReaderTests-117322171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d648b5c9-f054-4cf3-bd8d-62b3adaa16b4" returned: 0 in 0.286s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b3b82406-78fa-440b-8bc3-4a5dfee4b2b3 tempest-ProjectReaderTests-117322171 None] Lock "cinder-quobyte-d648b5c9-f054-4cf3-bd8d-62b3adaa16b4" released by "delete_volume" :: held 0.826s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:24:04 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-b3b82406-78fa-440b-8bc3-4a5dfee4b2b3 tempest-ProjectReaderTests-117322171 None] Created reservations ['c539db25-9778-4997-aa43-c8f339ff639b', 'a9c5c57f-b2fb-4449-b637-0d47aad4f29f', '0fca2d5f-708d-4360-ae99-78d8ec510504', '0789b4fe-44ae-45e5-a478-5bea177f3be4'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:24:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b3b82406-78fa-440b-8bc3-4a5dfee4b2b3 tempest-ProjectReaderTests-117322171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:24:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b3b82406-78fa-440b-8bc3-4a5dfee4b2b3 tempest-ProjectReaderTests-117322171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:24:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b3b82406-78fa-440b-8bc3-4a5dfee4b2b3 tempest-ProjectReaderTests-117322171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:24:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b3b82406-78fa-440b-8bc3-4a5dfee4b2b3 tempest-ProjectReaderTests-117322171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:24:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b3b82406-78fa-440b-8bc3-4a5dfee4b2b3 tempest-ProjectReaderTests-117322171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:24:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b3b82406-78fa-440b-8bc3-4a5dfee4b2b3 tempest-ProjectReaderTests-117322171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-872c9f2f-ea9b-4a64-9eda-da566ee17777 tempest-VolumesActionsTest-383491166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:24:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-872c9f2f-ea9b-4a64-9eda-da566ee17777 tempest-VolumesActionsTest-383491166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:24:04 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:24:04 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:04 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7eed7f5-dca4-4b24-94e9-45bd0fba3e5d]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:24:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-872c9f2f-ea9b-4a64-9eda-da566ee17777 tempest-VolumesActionsTest-383491166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:05 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4 Nov 03 08:24:05 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:05 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b3b82406-78fa-440b-8bc3-4a5dfee4b2b3 tempest-ProjectReaderTests-117322171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.313s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:05 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-b3b82406-78fa-440b-8bc3-4a5dfee4b2b3 tempest-ProjectReaderTests-117322171 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:24:05 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-b3b82406-78fa-440b-8bc3-4a5dfee4b2b3 tempest-ProjectReaderTests-117322171 None] Deleted volume successfully. Nov 03 08:24:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b3b82406-78fa-440b-8bc3-4a5dfee4b2b3 tempest-ProjectReaderTests-117322171 None] Lock "cinder-d648b5c9-f054-4cf3-bd8d-62b3adaa16b4-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:24:05 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-872c9f2f-ea9b-4a64-9eda-da566ee17777 tempest-VolumesActionsTest-383491166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4" returned: 0 in 0.573s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:05 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b4e299-614b-4c85-892f-226069283697]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:24:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-872c9f2f-ea9b-4a64-9eda-da566ee17777 tempest-VolumesActionsTest-383491166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:05 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4 Nov 03 08:24:05 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:06 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-872c9f2f-ea9b-4a64-9eda-da566ee17777 tempest-VolumesActionsTest-383491166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4" returned: 0 in 0.471s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-872c9f2f-ea9b-4a64-9eda-da566ee17777 tempest-VolumesActionsTest-383491166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4 /opt/stack/data/cinder/conversion/c82d4837-1606-4b56-8139-146ee99aa1d4.temp_image.7b65781e-f5e4-4cbd-ba38-283a919d1cddd_ddccjd.img {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:06 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4 /opt/stack/data/cinder/conversion/c82d4837-1606-4b56-8139-146ee99aa1d4.temp_image.7b65781e-f5e4-4cbd-ba38-283a919d1cddd_ddccjd.img Nov 03 08:24:06 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:06 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9509a63e-2aed-4ec6-92bd-2495c34d985d tempest-VolumesSnapshotListTestJSON-104002281 None] Acquiring lock "cinder-3b85f7fc-c478-4a4f-a0d9-5313cc9e6889-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:24:06 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9509a63e-2aed-4ec6-92bd-2495c34d985d tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "cinder-3b85f7fc-c478-4a4f-a0d9-5313cc9e6889-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:24:06 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9509a63e-2aed-4ec6-92bd-2495c34d985d tempest-VolumesSnapshotListTestJSON-104002281 None] Acquiring lock "cinder-quobyte-73790bbc-0e56-4a9e-b87f-b9668f135225" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:24:06 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9509a63e-2aed-4ec6-92bd-2495c34d985d tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "cinder-quobyte-73790bbc-0e56-4a9e-b87f-b9668f135225" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:24:06 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9509a63e-2aed-4ec6-92bd-2495c34d985d tempest-VolumesSnapshotListTestJSON-104002281 None] Acquiring lock "cinder-quobyte-3b85f7fc-c478-4a4f-a0d9-5313cc9e6889" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:24:06 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9509a63e-2aed-4ec6-92bd-2495c34d985d tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "cinder-quobyte-3b85f7fc-c478-4a4f-a0d9-5313cc9e6889" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:24:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-9509a63e-2aed-4ec6-92bd-2495c34d985d tempest-VolumesSnapshotListTestJSON-104002281 None] Deleting offline snapshot 3b85f7fc-c478-4a4f-a0d9-5313cc9e6889 of volume 73790bbc-0e56-4a9e-b87f-b9668f135225 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:24:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-9509a63e-2aed-4ec6-92bd-2495c34d985d tempest-VolumesSnapshotListTestJSON-104002281 None] snapshot_file for this snap is: volume-73790bbc-0e56-4a9e-b87f-b9668f135225.3b85f7fc-c478-4a4f-a0d9-5313cc9e6889 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:24:06 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[96808a8f-f026-4ef1-9d74-fd1b69784771]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:24:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9509a63e-2aed-4ec6-92bd-2495c34d985d tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.3b85f7fc-c478-4a4f-a0d9-5313cc9e6889 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:06 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.3b85f7fc-c478-4a4f-a0d9-5313cc9e6889 Nov 03 08:24:06 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:06 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:24:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Flow 'volume_create_manager' (9cb96286-8306-451b-b353-ea8584e00eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:24:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b084878-3c8b-47bf-b2e0-e6a4b5a80531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b084878-3c8b-47bf-b2e0-e6a4b5a80531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1958099758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25fa66a5-1364-4ee5-9d5a-38e1890defc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b97e114fa9c4cf7b4003d9889bb98cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:24:07Z,use_quota=True,user_id='04dde37bd9834bb59abd27fcf08c4914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12dc74c-d4b9-4762-b1a4-9adb3e4cc26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12dc74c-d4b9-4762-b1a4-9adb3e4cc26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1eaa5c7-b533-4b16-a243-42de9ffa8b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1eaa5c7-b533-4b16-a243-42de9ffa8b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25fa66a5-1364-4ee5-9d5a-38e1890defc6', 'volume_name': 'volume-25fa66a5-1364-4ee5-9d5a-38e1890defc6', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6482c2f8-2c2e-4a2b-85e1-f58a926952b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6482c2f8-2c2e-4a2b-85e1-f58a926952b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99846686-15a5-496a-8129-f48e2204cdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:06 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Volume 25fa66a5-1364-4ee5-9d5a-38e1890defc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25fa66a5-1364-4ee5-9d5a-38e1890defc6', 'volume_size': 1} Nov 03 08:24:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:24:07 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9509a63e-2aed-4ec6-92bd-2495c34d985d tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.3b85f7fc-c478-4a4f-a0d9-5313cc9e6889" returned: 0 in 0.698s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:07 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-9509a63e-2aed-4ec6-92bd-2495c34d985d tempest-VolumesSnapshotListTestJSON-104002281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73790bbc-0e56-4a9e-b87f-b9668f135225(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:24:07 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa0caa1-8ced-4f49-980a-41950a4be02f]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:24:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9509a63e-2aed-4ec6-92bd-2495c34d985d tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:07 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7 Nov 03 08:24:07 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:07 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9509a63e-2aed-4ec6-92bd-2495c34d985d tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7" returned: 0 in 0.548s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:07 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-9509a63e-2aed-4ec6-92bd-2495c34d985d tempest-VolumesSnapshotListTestJSON-104002281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73790bbc-0e56-4a9e-b87f-b9668f135225(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:24:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9509a63e-2aed-4ec6-92bd-2495c34d985d tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.3b85f7fc-c478-4a4f-a0d9-5313cc9e6889 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:07 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.3b85f7fc-c478-4a4f-a0d9-5313cc9e6889 Nov 03 08:24:07 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:08 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9509a63e-2aed-4ec6-92bd-2495c34d985d tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.3b85f7fc-c478-4a4f-a0d9-5313cc9e6889" returned: 0 in 0.932s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9509a63e-2aed-4ec6-92bd-2495c34d985d tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.3b85f7fc-c478-4a4f-a0d9-5313cc9e6889 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:08 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.3b85f7fc-c478-4a4f-a0d9-5313cc9e6889 Nov 03 08:24:08 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:09 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9509a63e-2aed-4ec6-92bd-2495c34d985d tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.3b85f7fc-c478-4a4f-a0d9-5313cc9e6889" returned: 0 in 0.427s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:09 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9509a63e-2aed-4ec6-92bd-2495c34d985d tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "cinder-quobyte-3b85f7fc-c478-4a4f-a0d9-5313cc9e6889" released by "_delete_snapshot" :: held 2.855s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:24:09 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9509a63e-2aed-4ec6-92bd-2495c34d985d tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "cinder-quobyte-73790bbc-0e56-4a9e-b87f-b9668f135225" released by "delete_snapshot" :: held 2.905s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:24:09 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-9509a63e-2aed-4ec6-92bd-2495c34d985d tempest-VolumesSnapshotListTestJSON-104002281 None] Created reservations ['a5227966-e022-4d51-a7a8-72b9ce58ecff', '48908dc8-fd33-4325-8624-ca0048026ef3', '9657d583-cedd-4af3-8641-51b865c36964', 'e8817b98-31d4-486d-bcc1-e6b18bbfe695'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:24:09 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-9509a63e-2aed-4ec6-92bd-2495c34d985d tempest-VolumesSnapshotListTestJSON-104002281 None] Delete snapshot completed successfully. Nov 03 08:24:09 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9509a63e-2aed-4ec6-92bd-2495c34d985d tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "cinder-3b85f7fc-c478-4a4f-a0d9-5313cc9e6889-delete_snapshot" released by "delete_snapshot" :: held 3.223s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:24:09 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b8208ec2-580f-47b0-aafc-592da392b7c4 tempest-VolumesSnapshotListTestJSON-104002281 None] Acquiring lock "cinder-5cdfbda4-207c-43c4-9e5f-1ac04763aae7-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:24:09 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b8208ec2-580f-47b0-aafc-592da392b7c4 tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "cinder-5cdfbda4-207c-43c4-9e5f-1ac04763aae7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:24:09 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b8208ec2-580f-47b0-aafc-592da392b7c4 tempest-VolumesSnapshotListTestJSON-104002281 None] Acquiring lock "cinder-quobyte-73790bbc-0e56-4a9e-b87f-b9668f135225" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:24:09 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b8208ec2-580f-47b0-aafc-592da392b7c4 tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "cinder-quobyte-73790bbc-0e56-4a9e-b87f-b9668f135225" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:24:09 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b8208ec2-580f-47b0-aafc-592da392b7c4 tempest-VolumesSnapshotListTestJSON-104002281 None] Acquiring lock "cinder-quobyte-5cdfbda4-207c-43c4-9e5f-1ac04763aae7" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:24:09 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b8208ec2-580f-47b0-aafc-592da392b7c4 tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "cinder-quobyte-5cdfbda4-207c-43c4-9e5f-1ac04763aae7" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:24:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-b8208ec2-580f-47b0-aafc-592da392b7c4 tempest-VolumesSnapshotListTestJSON-104002281 None] Deleting offline snapshot 5cdfbda4-207c-43c4-9e5f-1ac04763aae7 of volume 73790bbc-0e56-4a9e-b87f-b9668f135225 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:24:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-b8208ec2-580f-47b0-aafc-592da392b7c4 tempest-VolumesSnapshotListTestJSON-104002281 None] snapshot_file for this snap is: volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:24:09 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fe8f83-5193-4504-9ede-46f3ffc2c0a6]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:24:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b8208ec2-580f-47b0-aafc-592da392b7c4 tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:09 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7 Nov 03 08:24:09 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:10 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b8208ec2-580f-47b0-aafc-592da392b7c4 tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7" returned: 0 in 0.636s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:10 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-b8208ec2-580f-47b0-aafc-592da392b7c4 tempest-VolumesSnapshotListTestJSON-104002281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73790bbc-0e56-4a9e-b87f-b9668f135225(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:24:10 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3606d1-ed9a-40ca-abcf-f5f1c6e960f3]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:24:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b8208ec2-580f-47b0-aafc-592da392b7c4 tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:10 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b Nov 03 08:24:10 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:11 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b8208ec2-580f-47b0-aafc-592da392b7c4 tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b" returned: 0 in 0.669s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:11 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-b8208ec2-580f-47b0-aafc-592da392b7c4 tempest-VolumesSnapshotListTestJSON-104002281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73790bbc-0e56-4a9e-b87f-b9668f135225(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:24:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b8208ec2-580f-47b0-aafc-592da392b7c4 tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:11 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7 Nov 03 08:24:11 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:11 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:24:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Flow 'volume_create_manager' (0e020e24-27c0-4222-b727-260e7da792b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:24:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9bfbd63-7c73-440b-b8ff-97e0b3a5e8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9bfbd63-7c73-440b-b8ff-97e0b3a5e8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1088162378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620ad3e9-3523-42fe-ac2e-b8b31784cdc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf24bec3f074d74bc69d4aba6cbcb0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:24:11Z,use_quota=True,user_id='aa28228ec1c74feebd9a65d418c09946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad09a1a6-e18e-4706-a141-396261a7561c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad09a1a6-e18e-4706-a141-396261a7561c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e1e160a-b122-40a9-bdad-d9b50a5ddb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e1e160a-b122-40a9-bdad-d9b50a5ddb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '620ad3e9-3523-42fe-ac2e-b8b31784cdc6', 'volume_name': 'volume-620ad3e9-3523-42fe-ac2e-b8b31784cdc6', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a6a121f-3b24-4eab-a978-d14e38ab58a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a6a121f-3b24-4eab-a978-d14e38ab58a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c58719d-3d6f-49ad-943a-6fd38810ecb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:11 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Volume 620ad3e9-3523-42fe-ac2e-b8b31784cdc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-620ad3e9-3523-42fe-ac2e-b8b31784cdc6', 'volume_size': 1} Nov 03 08:24:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:24:11 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b8208ec2-580f-47b0-aafc-592da392b7c4 tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7" returned: 0 in 0.835s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b8208ec2-580f-47b0-aafc-592da392b7c4 tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:12 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7 Nov 03 08:24:12 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:12 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b8208ec2-580f-47b0-aafc-592da392b7c4 tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.5cdfbda4-207c-43c4-9e5f-1ac04763aae7" returned: 0 in 0.503s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:12 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b8208ec2-580f-47b0-aafc-592da392b7c4 tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "cinder-quobyte-5cdfbda4-207c-43c4-9e5f-1ac04763aae7" released by "_delete_snapshot" :: held 2.894s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:24:12 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b8208ec2-580f-47b0-aafc-592da392b7c4 tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "cinder-quobyte-73790bbc-0e56-4a9e-b87f-b9668f135225" released by "delete_snapshot" :: held 2.944s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:24:12 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-b8208ec2-580f-47b0-aafc-592da392b7c4 tempest-VolumesSnapshotListTestJSON-104002281 None] Created reservations ['067205ce-a1be-492c-99eb-bc364b2e4aff', '9ad21eb2-2abc-4a72-92cc-14bfde1cf83d', 'e814a9c9-5732-453a-b53f-ffb791c21e62', 'b2a1cf27-9344-48f6-a758-37e73a88f4fa'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:24:12 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-b8208ec2-580f-47b0-aafc-592da392b7c4 tempest-VolumesSnapshotListTestJSON-104002281 None] Delete snapshot completed successfully. Nov 03 08:24:12 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b8208ec2-580f-47b0-aafc-592da392b7c4 tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "cinder-5cdfbda4-207c-43c4-9e5f-1ac04763aae7-delete_snapshot" released by "delete_snapshot" :: held 3.159s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:24:12 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ea798a10-0ae6-4b10-a373-982fbf4ad385 tempest-VolumesSnapshotListTestJSON-104002281 None] Acquiring lock "cinder-dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:24:12 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ea798a10-0ae6-4b10-a373-982fbf4ad385 tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "cinder-dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:24:12 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ea798a10-0ae6-4b10-a373-982fbf4ad385 tempest-VolumesSnapshotListTestJSON-104002281 None] Acquiring lock "cinder-quobyte-73790bbc-0e56-4a9e-b87f-b9668f135225" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:24:12 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ea798a10-0ae6-4b10-a373-982fbf4ad385 tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "cinder-quobyte-73790bbc-0e56-4a9e-b87f-b9668f135225" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:24:12 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ea798a10-0ae6-4b10-a373-982fbf4ad385 tempest-VolumesSnapshotListTestJSON-104002281 None] Acquiring lock "cinder-quobyte-dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:24:12 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ea798a10-0ae6-4b10-a373-982fbf4ad385 tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "cinder-quobyte-dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:24:12 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-ea798a10-0ae6-4b10-a373-982fbf4ad385 tempest-VolumesSnapshotListTestJSON-104002281 None] Deleting offline snapshot dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b of volume 73790bbc-0e56-4a9e-b87f-b9668f135225 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:24:12 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-ea798a10-0ae6-4b10-a373-982fbf4ad385 tempest-VolumesSnapshotListTestJSON-104002281 None] snapshot_file for this snap is: volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:24:12 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bacad1-7f4e-47bc-b130-d8fe3af41a3d]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:24:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ea798a10-0ae6-4b10-a373-982fbf4ad385 tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:13 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b Nov 03 08:24:13 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:13 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ea798a10-0ae6-4b10-a373-982fbf4ad385 tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b" returned: 0 in 0.608s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:13 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-ea798a10-0ae6-4b10-a373-982fbf4ad385 tempest-VolumesSnapshotListTestJSON-104002281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73790bbc-0e56-4a9e-b87f-b9668f135225(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:24:13 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-872c9f2f-ea9b-4a64-9eda-da566ee17777 tempest-VolumesActionsTest-383491166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4 /opt/stack/data/cinder/conversion/c82d4837-1606-4b56-8139-146ee99aa1d4.temp_image.7b65781e-f5e4-4cbd-ba38-283a919d1cddd_ddccjd.img" returned: 0 in 7.582s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:13 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d85db3-07fb-422f-9841-af5e2953df51]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:24:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ea798a10-0ae6-4b10-a373-982fbf4ad385 tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:13 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccc4ea7-d138-43e8-875f-6acc628298bb]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:24:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-872c9f2f-ea9b-4a64-9eda-da566ee17777 tempest-VolumesActionsTest-383491166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:13 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225 Nov 03 08:24:13 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:13 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4 Nov 03 08:24:13 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:13 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ea798a10-0ae6-4b10-a373-982fbf4ad385 tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225" returned: 0 in 0.368s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ea798a10-0ae6-4b10-a373-982fbf4ad385 tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:14 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b Nov 03 08:24:14 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:14 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-872c9f2f-ea9b-4a64-9eda-da566ee17777 tempest-VolumesActionsTest-383491166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4" returned: 0 in 0.548s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:14 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-872c9f2f-ea9b-4a64-9eda-da566ee17777 tempest-VolumesActionsTest-383491166 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4, size 1024.00 MB, duration 7.58 sec, destination /opt/stack/data/cinder/conversion/c82d4837-1606-4b56-8139-146ee99aa1d4.temp_image.7b65781e-f5e4-4cbd-ba38-283a919d1cddd_ddccjd.img {{(pid=86801) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 08:24:14 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-872c9f2f-ea9b-4a64-9eda-da566ee17777 tempest-VolumesActionsTest-383491166 None] Converted 1024.00 MB image at 135.03 MB/s Nov 03 08:24:14 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-872c9f2f-ea9b-4a64-9eda-da566ee17777 tempest-VolumesActionsTest-383491166 None] 7b65781e-f5e4-4cbd-ba38-283a919d1cdd was raw, no need to convert to raw {{(pid=86801) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 03 08:24:14 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ea798a10-0ae6-4b10-a373-982fbf4ad385 tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b" returned: 0 in 0.369s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ea798a10-0ae6-4b10-a373-982fbf4ad385 tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:14 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b Nov 03 08:24:14 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:14 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ea798a10-0ae6-4b10-a373-982fbf4ad385 tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225.dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b" returned: 0 in 0.259s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:14 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ea798a10-0ae6-4b10-a373-982fbf4ad385 tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "cinder-quobyte-dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b" released by "_delete_snapshot" :: held 1.748s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:24:14 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ea798a10-0ae6-4b10-a373-982fbf4ad385 tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "cinder-quobyte-73790bbc-0e56-4a9e-b87f-b9668f135225" released by "delete_snapshot" :: held 1.774s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:24:14 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-ea798a10-0ae6-4b10-a373-982fbf4ad385 tempest-VolumesSnapshotListTestJSON-104002281 None] Created reservations ['36add6e5-31ae-4967-a728-b528e4840df3', '915da873-0e15-499e-a37e-b2ca059e075a', '21c379d3-2e38-4008-8020-f71346c7c3b9', '17465d60-a7e9-4add-b92b-c8c5951ead5c'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:24:14 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-ea798a10-0ae6-4b10-a373-982fbf4ad385 tempest-VolumesSnapshotListTestJSON-104002281 None] Delete snapshot completed successfully. Nov 03 08:24:14 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ea798a10-0ae6-4b10-a373-982fbf4ad385 tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "cinder-dae62b5f-2ce9-4fd9-8ef5-10611cab4c4b-delete_snapshot" released by "delete_snapshot" :: held 1.924s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:24:15 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-034e4578-7a0a-4383-a9be-6585f9fa61e8 tempest-VolumesSnapshotListTestJSON-104002281 None] Acquiring lock "cinder-73790bbc-0e56-4a9e-b87f-b9668f135225-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:24:15 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-034e4578-7a0a-4383-a9be-6585f9fa61e8 tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "cinder-73790bbc-0e56-4a9e-b87f-b9668f135225-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:24:15 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-034e4578-7a0a-4383-a9be-6585f9fa61e8 tempest-VolumesSnapshotListTestJSON-104002281 None] Acquiring lock "cinder-quobyte-73790bbc-0e56-4a9e-b87f-b9668f135225" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:24:15 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-034e4578-7a0a-4383-a9be-6585f9fa61e8 tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "cinder-quobyte-73790bbc-0e56-4a9e-b87f-b9668f135225" acquired by "delete_volume" :: waited 0.019s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:24:15 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[58441bf4-5eb5-4b5f-acd7-21f16aef2ec1]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:24:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-034e4578-7a0a-4383-a9be-6585f9fa61e8 tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:15 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225 Nov 03 08:24:15 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:15 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-034e4578-7a0a-4383-a9be-6585f9fa61e8 tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225" returned: 0 in 0.372s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-034e4578-7a0a-4383-a9be-6585f9fa61e8 tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:15 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225 Nov 03 08:24:15 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:15 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-034e4578-7a0a-4383-a9be-6585f9fa61e8 tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-73790bbc-0e56-4a9e-b87f-b9668f135225" returned: 0 in 0.268s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:15 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-034e4578-7a0a-4383-a9be-6585f9fa61e8 tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "cinder-quobyte-73790bbc-0e56-4a9e-b87f-b9668f135225" released by "delete_volume" :: held 0.729s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:24:15 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-034e4578-7a0a-4383-a9be-6585f9fa61e8 tempest-VolumesSnapshotListTestJSON-104002281 None] Created reservations ['4287c939-098e-4510-9227-258620f74b2c', 'e6281b0d-1102-44cd-9485-3bfb20fc8d80', '63d8a9b0-d965-4378-a6fd-c8584da2de24', '52ca7b86-3e8e-4dc5-9f5a-3ba5dea68fc4'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:24:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-034e4578-7a0a-4383-a9be-6585f9fa61e8 tempest-VolumesSnapshotListTestJSON-104002281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:24:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-034e4578-7a0a-4383-a9be-6585f9fa61e8 tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:24:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-034e4578-7a0a-4383-a9be-6585f9fa61e8 tempest-VolumesSnapshotListTestJSON-104002281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:24:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-034e4578-7a0a-4383-a9be-6585f9fa61e8 tempest-VolumesSnapshotListTestJSON-104002281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:24:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-034e4578-7a0a-4383-a9be-6585f9fa61e8 tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:24:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-034e4578-7a0a-4383-a9be-6585f9fa61e8 tempest-VolumesSnapshotListTestJSON-104002281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:16 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:24:16 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:16 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-034e4578-7a0a-4383-a9be-6585f9fa61e8 tempest-VolumesSnapshotListTestJSON-104002281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.304s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:16 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-034e4578-7a0a-4383-a9be-6585f9fa61e8 tempest-VolumesSnapshotListTestJSON-104002281 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:24:16 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-034e4578-7a0a-4383-a9be-6585f9fa61e8 tempest-VolumesSnapshotListTestJSON-104002281 None] Deleted volume successfully. Nov 03 08:24:16 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-034e4578-7a0a-4383-a9be-6585f9fa61e8 tempest-VolumesSnapshotListTestJSON-104002281 None] Lock "cinder-73790bbc-0e56-4a9e-b87f-b9668f135225-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:24:25 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=45,cinder:UPDATE=41,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:24:26 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=38,cinder:DELETE=4,cinder:INSERT=14,cinder:UPDATE=42 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:24:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-872c9f2f-ea9b-4a64-9eda-da566ee17777 tempest-VolumesActionsTest-383491166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.688s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:24:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-872c9f2f-ea9b-4a64-9eda-da566ee17777 tempest-VolumesActionsTest-383491166 None] Uploaded volume to glance image-id: 7b65781e-f5e4-4cbd-ba38-283a919d1cdd. {{(pid=86801) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 08:24:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.823s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:24:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1958099758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25fa66a5-1364-4ee5-9d5a-38e1890defc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b97e114fa9c4cf7b4003d9889bb98cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:24:07Z,use_quota=True,user_id='04dde37bd9834bb59abd27fcf08c4914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:24:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Creating volume 25fa66a5-1364-4ee5-9d5a-38e1890defc6 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:24:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:24:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:24:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:24:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:24:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:24:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:24:35 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:24:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25fa66a5-1364-4ee5-9d5a-38e1890defc6 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:35 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25fa66a5-1364-4ee5-9d5a-38e1890defc6 1073741824 Nov 03 08:24:35 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:35 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-872c9f2f-ea9b-4a64-9eda-da566ee17777 tempest-VolumesActionsTest-383491166 None] Copy volume to image completed successfully. Nov 03 08:24:36 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25fa66a5-1364-4ee5-9d5a-38e1890defc6 1073741824" returned: 0 in 0.517s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25fa66a5-1364-4ee5-9d5a-38e1890defc6 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:36 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25fa66a5-1364-4ee5-9d5a-38e1890defc6 Nov 03 08:24:36 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:36 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25fa66a5-1364-4ee5-9d5a-38e1890defc6" returned: 0 in 0.289s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:24:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:24:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.765s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:24:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1088162378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620ad3e9-3523-42fe-ac2e-b8b31784cdc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf24bec3f074d74bc69d4aba6cbcb0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:24:11Z,use_quota=True,user_id='aa28228ec1c74feebd9a65d418c09946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:24:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Creating volume 620ad3e9-3523-42fe-ac2e-b8b31784cdc6 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:24:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:24:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:24:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:24:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:24:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:24:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:24:36 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:24:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-620ad3e9-3523-42fe-ac2e-b8b31784cdc6 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99846686-15a5-496a-8129-f48e2204cdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25fa66a5-1364-4ee5-9d5a-38e1890defc6', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c163bf-fd0e-4758-b3f3-010c0f663961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:36 devstack sudo[98235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-620ad3e9-3523-42fe-ac2e-b8b31784cdc6 1073741824 Nov 03 08:24:36 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:36 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Volume volume-25fa66a5-1364-4ee5-9d5a-38e1890defc6 (25fa66a5-1364-4ee5-9d5a-38e1890defc6): created successfully Nov 03 08:24:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c163bf-fd0e-4758-b3f3-010c0f663961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Flow 'volume_create_manager' (9cb96286-8306-451b-b353-ea8584e00eff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:24:36 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-b1996b9e-0326-4112-938c-0c70ec38c5db tempest-ProjectReaderTests-117322171 None] Created volume successfully. Nov 03 08:24:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e4bf7851-703e-43cf-8300-1f9cbd2b8033 tempest-ProjectReaderTests-117322171 None] Acquiring lock "cinder-25fa66a5-1364-4ee5-9d5a-38e1890defc6-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:24:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e4bf7851-703e-43cf-8300-1f9cbd2b8033 tempest-ProjectReaderTests-117322171 None] Lock "cinder-25fa66a5-1364-4ee5-9d5a-38e1890defc6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:24:37 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-620ad3e9-3523-42fe-ac2e-b8b31784cdc6 1073741824" returned: 0 in 0.620s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e4bf7851-703e-43cf-8300-1f9cbd2b8033 tempest-ProjectReaderTests-117322171 None] Acquiring lock "cinder-quobyte-25fa66a5-1364-4ee5-9d5a-38e1890defc6" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:24:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-620ad3e9-3523-42fe-ac2e-b8b31784cdc6 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e4bf7851-703e-43cf-8300-1f9cbd2b8033 tempest-ProjectReaderTests-117322171 None] Lock "cinder-quobyte-25fa66a5-1364-4ee5-9d5a-38e1890defc6" acquired by "delete_volume" :: waited 0.037s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:24:37 devstack sudo[98241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-620ad3e9-3523-42fe-ac2e-b8b31784cdc6 Nov 03 08:24:37 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:37 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8900068-94a9-4660-86e9-599f34d05ccd]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:24:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e4bf7851-703e-43cf-8300-1f9cbd2b8033 tempest-ProjectReaderTests-117322171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25fa66a5-1364-4ee5-9d5a-38e1890defc6 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:37 devstack sudo[98243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25fa66a5-1364-4ee5-9d5a-38e1890defc6 Nov 03 08:24:37 devstack sudo[98243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-79087230-1962-441a-8277-310098f160a1 tempest-VolumesActionsTest-383491166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:24:37 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-620ad3e9-3523-42fe-ac2e-b8b31784cdc6" returned: 0 in 0.388s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:24:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:24:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-79087230-1962-441a-8277-310098f160a1 tempest-VolumesActionsTest-383491166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.055s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:24:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c58719d-3d6f-49ad-943a-6fd38810ecb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-620ad3e9-3523-42fe-ac2e-b8b31784cdc6', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8988b2aa-4d25-45a0-ac54-c69ad1efdb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:37 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bd1bf3-2c5c-4f68-b9ab-3c0879eb3f8f]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:24:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-79087230-1962-441a-8277-310098f160a1 tempest-VolumesActionsTest-383491166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:37 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Volume volume-620ad3e9-3523-42fe-ac2e-b8b31784cdc6 (620ad3e9-3523-42fe-ac2e-b8b31784cdc6): created successfully Nov 03 08:24:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8988b2aa-4d25-45a0-ac54-c69ad1efdb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Flow 'volume_create_manager' (0e020e24-27c0-4222-b727-260e7da792b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:24:37 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-4c99b227-ae1f-4efc-820c-530d0e9b4d4f tempest-VolumesListAdminTestJSON-1201312565 None] Created volume successfully. Nov 03 08:24:37 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4 Nov 03 08:24:37 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:37 devstack sudo[98243]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e4bf7851-703e-43cf-8300-1f9cbd2b8033 tempest-ProjectReaderTests-117322171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25fa66a5-1364-4ee5-9d5a-38e1890defc6" returned: 0 in 0.532s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e4bf7851-703e-43cf-8300-1f9cbd2b8033 tempest-ProjectReaderTests-117322171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25fa66a5-1364-4ee5-9d5a-38e1890defc6 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:37 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25fa66a5-1364-4ee5-9d5a-38e1890defc6 Nov 03 08:24:37 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:38 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-79087230-1962-441a-8277-310098f160a1 tempest-VolumesActionsTest-383491166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4" returned: 0 in 0.416s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:38 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e4bf7851-703e-43cf-8300-1f9cbd2b8033 tempest-ProjectReaderTests-117322171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-25fa66a5-1364-4ee5-9d5a-38e1890defc6" returned: 0 in 0.268s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:38 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e357f54-ec67-4869-91b4-5ca1cdbf439c]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:24:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-79087230-1962-441a-8277-310098f160a1 tempest-VolumesActionsTest-383491166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e4bf7851-703e-43cf-8300-1f9cbd2b8033 tempest-ProjectReaderTests-117322171 None] Lock "cinder-quobyte-25fa66a5-1364-4ee5-9d5a-38e1890defc6" released by "delete_volume" :: held 0.877s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:24:38 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-e4bf7851-703e-43cf-8300-1f9cbd2b8033 tempest-ProjectReaderTests-117322171 None] Created reservations ['c156c2e5-a271-46c6-8d73-b8ea13aa8a05', 'df95fd63-85bc-43ed-9d50-953724d4ef32', '7075fb8c-f4d2-421d-b62e-8e61ed21e802', '2cdd4ed0-f040-42a8-865b-f6ba95753424'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:24:38 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4 Nov 03 08:24:38 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e4bf7851-703e-43cf-8300-1f9cbd2b8033 tempest-ProjectReaderTests-117322171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:24:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e4bf7851-703e-43cf-8300-1f9cbd2b8033 tempest-ProjectReaderTests-117322171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:24:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e4bf7851-703e-43cf-8300-1f9cbd2b8033 tempest-ProjectReaderTests-117322171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:24:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e4bf7851-703e-43cf-8300-1f9cbd2b8033 tempest-ProjectReaderTests-117322171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:24:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e4bf7851-703e-43cf-8300-1f9cbd2b8033 tempest-ProjectReaderTests-117322171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:24:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e4bf7851-703e-43cf-8300-1f9cbd2b8033 tempest-ProjectReaderTests-117322171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:38 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:24:38 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:38 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e4bf7851-703e-43cf-8300-1f9cbd2b8033 tempest-ProjectReaderTests-117322171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.340s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:38 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-e4bf7851-703e-43cf-8300-1f9cbd2b8033 tempest-ProjectReaderTests-117322171 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:24:38 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-e4bf7851-703e-43cf-8300-1f9cbd2b8033 tempest-ProjectReaderTests-117322171 None] Deleted volume successfully. Nov 03 08:24:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e4bf7851-703e-43cf-8300-1f9cbd2b8033 tempest-ProjectReaderTests-117322171 None] Lock "cinder-25fa66a5-1364-4ee5-9d5a-38e1890defc6-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:24:38 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-79087230-1962-441a-8277-310098f160a1 tempest-VolumesActionsTest-383491166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4" returned: 0 in 0.610s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-79087230-1962-441a-8277-310098f160a1 tempest-VolumesActionsTest-383491166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4 /opt/stack/data/cinder/conversion/c82d4837-1606-4b56-8139-146ee99aa1d4.temp_image.edb7ade6-959b-4365-85fc-bd3210b8720bqjw8hcvk.img {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:38 devstack sudo[98265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4 /opt/stack/data/cinder/conversion/c82d4837-1606-4b56-8139-146ee99aa1d4.temp_image.edb7ade6-959b-4365-85fc-bd3210b8720bqjw8hcvk.img Nov 03 08:24:38 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:39 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:24:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Flow 'volume_create_manager' (32464589-e547-46b2-83df-54851a8624f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:24:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8904344a-4173-4741-a51d-80529b982039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8904344a-4173-4741-a51d-80529b982039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1696977266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6556f099-9962-45b4-bfc3-6014db927f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf24bec3f074d74bc69d4aba6cbcb0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:24:39Z,use_quota=True,user_id='aa28228ec1c74feebd9a65d418c09946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (227d85b5-ffdd-445a-be20-6fc07a0af4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (227d85b5-ffdd-445a-be20-6fc07a0af4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e91cc572-62da-4900-88de-f396aee58a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e91cc572-62da-4900-88de-f396aee58a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6556f099-9962-45b4-bfc3-6014db927f1b', 'volume_name': 'volume-6556f099-9962-45b4-bfc3-6014db927f1b', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7edb296b-c7ac-4b6c-982e-1b5c6b53327f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7edb296b-c7ac-4b6c-982e-1b5c6b53327f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80451c2-f6b9-4a56-a972-39e279b3bd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:39 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Volume 6556f099-9962-45b4-bfc3-6014db927f1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6556f099-9962-45b4-bfc3-6014db927f1b', 'volume_size': 1} Nov 03 08:24:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:24:46 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-79087230-1962-441a-8277-310098f160a1 tempest-VolumesActionsTest-383491166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4 /opt/stack/data/cinder/conversion/c82d4837-1606-4b56-8139-146ee99aa1d4.temp_image.edb7ade6-959b-4365-85fc-bd3210b8720bqjw8hcvk.img" returned: 0 in 8.044s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:46 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e236f31-b983-4217-969d-dad74d0a3dfb]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:24:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-79087230-1962-441a-8277-310098f160a1 tempest-VolumesActionsTest-383491166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:46 devstack sudo[98283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4 Nov 03 08:24:46 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:47 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:24:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Flow 'volume_create_manager' (81cf3649-cb5f-4482-a47a-7021eab92d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:24:47 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a02b27-35c5-431c-96e8-7bbaff86c4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-79087230-1962-441a-8277-310098f160a1 tempest-VolumesActionsTest-383491166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4" returned: 0 in 0.569s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:47 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-79087230-1962-441a-8277-310098f160a1 tempest-VolumesActionsTest-383491166 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4, size 1024.00 MB, duration 8.04 sec, destination /opt/stack/data/cinder/conversion/c82d4837-1606-4b56-8139-146ee99aa1d4.temp_image.edb7ade6-959b-4365-85fc-bd3210b8720bqjw8hcvk.img {{(pid=86801) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 08:24:47 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-79087230-1962-441a-8277-310098f160a1 tempest-VolumesActionsTest-383491166 None] Converted 1024.00 MB image at 127.29 MB/s Nov 03 08:24:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a02b27-35c5-431c-96e8-7bbaff86c4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-768170084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662df0ef-8a4d-4103-a44e-200bd24397fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fb45dba92b4e72b7f1f98c37c329af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:24:47Z,use_quota=True,user_id='dddeb7b6abb04c1f8b09d5fa060b214f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b3af3d-6aef-484c-a862-571d63aa60e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b3af3d-6aef-484c-a862-571d63aa60e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b650cbfc-16b6-4d52-8fea-bc55b7be7609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b650cbfc-16b6-4d52-8fea-bc55b7be7609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '662df0ef-8a4d-4103-a44e-200bd24397fb', 'volume_name': 'volume-662df0ef-8a4d-4103-a44e-200bd24397fb', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfe61c8f-fb84-480d-82d8-93745d5603d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfe61c8f-fb84-480d-82d8-93745d5603d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4879c352-06b7-4411-9648-9b1018753644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:47 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Volume 662df0ef-8a4d-4103-a44e-200bd24397fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-662df0ef-8a4d-4103-a44e-200bd24397fb', 'volume_size': 1} Nov 03 08:24:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:24:47 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-79087230-1962-441a-8277-310098f160a1 tempest-VolumesActionsTest-383491166 None] edb7ade6-959b-4365-85fc-bd3210b8720b was raw, converting to qcow2 {{(pid=86801) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 03 08:24:47 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[d793a4f9-082e-4a6b-b4c9-6b511a54f441]: (4, 'raw') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:24:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-79087230-1962-441a-8277-310098f160a1 tempest-VolumesActionsTest-383491166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c82d4837-1606-4b56-8139-146ee99aa1d4.temp_image.edb7ade6-959b-4365-85fc-bd3210b8720bqjw8hcvk.img {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:47 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c82d4837-1606-4b56-8139-146ee99aa1d4.temp_image.edb7ade6-959b-4365-85fc-bd3210b8720bqjw8hcvk.img Nov 03 08:24:47 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:47 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-79087230-1962-441a-8277-310098f160a1 tempest-VolumesActionsTest-383491166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c82d4837-1606-4b56-8139-146ee99aa1d4.temp_image.edb7ade6-959b-4365-85fc-bd3210b8720bqjw8hcvk.img" returned: 0 in 0.327s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-79087230-1962-441a-8277-310098f160a1 tempest-VolumesActionsTest-383491166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c82d4837-1606-4b56-8139-146ee99aa1d4.temp_image.edb7ade6-959b-4365-85fc-bd3210b8720bqjw8hcvk.img {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:47 devstack sudo[98292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c82d4837-1606-4b56-8139-146ee99aa1d4.temp_image.edb7ade6-959b-4365-85fc-bd3210b8720bqjw8hcvk.img Nov 03 08:24:47 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:48 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-79087230-1962-441a-8277-310098f160a1 tempest-VolumesActionsTest-383491166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c82d4837-1606-4b56-8139-146ee99aa1d4.temp_image.edb7ade6-959b-4365-85fc-bd3210b8720bqjw8hcvk.img" returned: 1 in 0.327s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-79087230-1962-441a-8277-310098f160a1 tempest-VolumesActionsTest-383491166 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c82d4837-1606-4b56-8139-146ee99aa1d4.temp_image.edb7ade6-959b-4365-85fc-bd3210b8720bqjw8hcvk.img' failed. Not Retrying. {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 08:24:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-79087230-1962-441a-8277-310098f160a1 tempest-VolumesActionsTest-383491166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c82d4837-1606-4b56-8139-146ee99aa1d4.temp_image.edb7ade6-959b-4365-85fc-bd3210b8720bqjw8hcvk.img /opt/stack/data/cinder/conversion/vol_upload_tfmegguw {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:48 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c82d4837-1606-4b56-8139-146ee99aa1d4.temp_image.edb7ade6-959b-4365-85fc-bd3210b8720bqjw8hcvk.img /opt/stack/data/cinder/conversion/vol_upload_tfmegguw Nov 03 08:24:48 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:48 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-79087230-1962-441a-8277-310098f160a1 tempest-VolumesActionsTest-383491166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c82d4837-1606-4b56-8139-146ee99aa1d4.temp_image.edb7ade6-959b-4365-85fc-bd3210b8720bqjw8hcvk.img /opt/stack/data/cinder/conversion/vol_upload_tfmegguw" returned: 0 in 0.269s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:48 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-79087230-1962-441a-8277-310098f160a1 tempest-VolumesActionsTest-383491166 None] Image conversion details: src /opt/stack/data/cinder/conversion/c82d4837-1606-4b56-8139-146ee99aa1d4.temp_image.edb7ade6-959b-4365-85fc-bd3210b8720bqjw8hcvk.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_tfmegguw {{(pid=86801) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 08:24:48 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-79087230-1962-441a-8277-310098f160a1 tempest-VolumesActionsTest-383491166 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 03 08:24:48 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0f9768-78a9-4fbb-a7f5-795551d2ee9b]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:24:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-79087230-1962-441a-8277-310098f160a1 tempest-VolumesActionsTest-383491166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_tfmegguw {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:48 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_tfmegguw Nov 03 08:24:48 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:48 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-79087230-1962-441a-8277-310098f160a1 tempest-VolumesActionsTest-383491166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_tfmegguw" returned: 0 in 0.327s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-79087230-1962-441a-8277-310098f160a1 tempest-VolumesActionsTest-383491166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.664s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:24:50 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-79087230-1962-441a-8277-310098f160a1 tempest-VolumesActionsTest-383491166 None] Uploaded volume to glance image-id: edb7ade6-959b-4365-85fc-bd3210b8720b. {{(pid=86801) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 08:24:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.738s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:24:50 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1696977266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6556f099-9962-45b4-bfc3-6014db927f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf24bec3f074d74bc69d4aba6cbcb0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:24:39Z,use_quota=True,user_id='aa28228ec1c74feebd9a65d418c09946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:24:50 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Creating volume 6556f099-9962-45b4-bfc3-6014db927f1b {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:24:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:24:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:24:50 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:24:50 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:24:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:24:50 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:24:50 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:24:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6556f099-9962-45b4-bfc3-6014db927f1b 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:50 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6556f099-9962-45b4-bfc3-6014db927f1b 1073741824 Nov 03 08:24:50 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:50 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-79087230-1962-441a-8277-310098f160a1 tempest-VolumesActionsTest-383491166 None] Copy volume to image completed successfully. Nov 03 08:24:50 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6556f099-9962-45b4-bfc3-6014db927f1b 1073741824" returned: 0 in 0.608s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6556f099-9962-45b4-bfc3-6014db927f1b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:50 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6556f099-9962-45b4-bfc3-6014db927f1b Nov 03 08:24:50 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:51 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6556f099-9962-45b4-bfc3-6014db927f1b" returned: 0 in 0.260s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:51 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:24:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:24:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.845s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:24:51 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-768170084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662df0ef-8a4d-4103-a44e-200bd24397fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fb45dba92b4e72b7f1f98c37c329af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:24:47Z,use_quota=True,user_id='dddeb7b6abb04c1f8b09d5fa060b214f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:24:51 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Creating volume 662df0ef-8a4d-4103-a44e-200bd24397fb {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:24:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:24:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:24:51 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:24:51 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:24:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:24:51 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:24:51 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:24:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80451c2-f6b9-4a56-a972-39e279b3bd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6556f099-9962-45b4-bfc3-6014db927f1b', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8749d7c0-ae35-4150-95a5-26431f89a7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:51 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb 1073741824 Nov 03 08:24:51 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:51 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Volume volume-6556f099-9962-45b4-bfc3-6014db927f1b (6556f099-9962-45b4-bfc3-6014db927f1b): created successfully Nov 03 08:24:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8749d7c0-ae35-4150-95a5-26431f89a7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Flow 'volume_create_manager' (32464589-e547-46b2-83df-54851a8624f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:24:51 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-c7ecd51c-f9ec-4344-a575-ab50f7cc60c4 tempest-VolumesListAdminTestJSON-1201312565 None] Created volume successfully. Nov 03 08:24:51 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb 1073741824" returned: 0 in 0.471s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:51 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb Nov 03 08:24:51 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:52 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb" returned: 0 in 0.356s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:52 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:24:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:24:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4879c352-06b7-4411-9648-9b1018753644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-662df0ef-8a4d-4103-a44e-200bd24397fb', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (997a07b9-49fb-4e21-983b-c7fcd59144eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:52 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e3df40e6-806a-4c1f-a9d6-75d8c22159ec tempest-VolumesActionsTest-383491166 None] Acquiring lock "cinder-c82d4837-1606-4b56-8139-146ee99aa1d4-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:24:52 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Volume volume-662df0ef-8a4d-4103-a44e-200bd24397fb (662df0ef-8a4d-4103-a44e-200bd24397fb): created successfully Nov 03 08:24:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (997a07b9-49fb-4e21-983b-c7fcd59144eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Flow 'volume_create_manager' (81cf3649-cb5f-4482-a47a-7021eab92d5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:24:52 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e3df40e6-806a-4c1f-a9d6-75d8c22159ec tempest-VolumesActionsTest-383491166 None] Lock "cinder-c82d4837-1606-4b56-8139-146ee99aa1d4-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:24:52 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-ec898d0e-ad14-4de6-8658-f0560a0e5a44 tempest-TestStampPattern-1669571982 None] Created volume successfully. Nov 03 08:24:52 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e3df40e6-806a-4c1f-a9d6-75d8c22159ec tempest-VolumesActionsTest-383491166 None] Acquiring lock "cinder-quobyte-c82d4837-1606-4b56-8139-146ee99aa1d4" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:24:52 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e3df40e6-806a-4c1f-a9d6-75d8c22159ec tempest-VolumesActionsTest-383491166 None] Lock "cinder-quobyte-c82d4837-1606-4b56-8139-146ee99aa1d4" acquired by "delete_volume" :: waited 0.018s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:24:52 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e787d88-2d9b-4021-9757-bf47b5e63729]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:24:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e3df40e6-806a-4c1f-a9d6-75d8c22159ec tempest-VolumesActionsTest-383491166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:52 devstack sudo[98346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4 Nov 03 08:24:52 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:52 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e3df40e6-806a-4c1f-a9d6-75d8c22159ec tempest-VolumesActionsTest-383491166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4" returned: 0 in 0.567s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e3df40e6-806a-4c1f-a9d6-75d8c22159ec tempest-VolumesActionsTest-383491166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:52 devstack sudo[98363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4 Nov 03 08:24:52 devstack sudo[98363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Flow 'volume_create_manager' (7c74028e-8b08-4c6f-b5a8-f99b4dd1c68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d97b737d-ec41-42a9-b209-4fe52eefc2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d97b737d-ec41-42a9-b209-4fe52eefc2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2083199377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f228d327-87a5-45b2-92cc-4cdc2c8ec143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf24bec3f074d74bc69d4aba6cbcb0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:24:53Z,use_quota=True,user_id='aa28228ec1c74feebd9a65d418c09946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1442186-5aa6-4a15-b581-04d9b314a6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1442186-5aa6-4a15-b581-04d9b314a6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb9ec0b-f747-4213-9ba3-e60f9578717e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb9ec0b-f747-4213-9ba3-e60f9578717e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f228d327-87a5-45b2-92cc-4cdc2c8ec143', 'volume_name': 'volume-f228d327-87a5-45b2-92cc-4cdc2c8ec143', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1993fe0-d7e7-4338-9fcd-cb14ddc8ae21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1993fe0-d7e7-4338-9fcd-cb14ddc8ae21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e7b378-6704-47dd-a82c-cf7cf278be2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:53 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Volume f228d327-87a5-45b2-92cc-4cdc2c8ec143: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f228d327-87a5-45b2-92cc-4cdc2c8ec143', 'volume_size': 1} Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2083199377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f228d327-87a5-45b2-92cc-4cdc2c8ec143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf24bec3f074d74bc69d4aba6cbcb0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:24:53Z,use_quota=True,user_id='aa28228ec1c74feebd9a65d418c09946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Creating volume f228d327-87a5-45b2-92cc-4cdc2c8ec143 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:24:53 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f228d327-87a5-45b2-92cc-4cdc2c8ec143 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:53 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f228d327-87a5-45b2-92cc-4cdc2c8ec143 1073741824 Nov 03 08:24:53 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:53 devstack sudo[98363]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e3df40e6-806a-4c1f-a9d6-75d8c22159ec tempest-VolumesActionsTest-383491166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c82d4837-1606-4b56-8139-146ee99aa1d4" returned: 0 in 0.565s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e3df40e6-806a-4c1f-a9d6-75d8c22159ec tempest-VolumesActionsTest-383491166 None] Lock "cinder-quobyte-c82d4837-1606-4b56-8139-146ee99aa1d4" released by "delete_volume" :: held 1.211s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-e3df40e6-806a-4c1f-a9d6-75d8c22159ec tempest-VolumesActionsTest-383491166 None] Created reservations ['c7fc4f7f-9738-47f5-86f4-24080dccff56', 'acb11913-2a9b-47f7-8266-ab0db184ddd9', 'fe1412e9-4905-4a1c-acb9-eed560176d57', '28820051-14da-4229-b29b-380dc98c0269'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e3df40e6-806a-4c1f-a9d6-75d8c22159ec tempest-VolumesActionsTest-383491166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e3df40e6-806a-4c1f-a9d6-75d8c22159ec tempest-VolumesActionsTest-383491166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e3df40e6-806a-4c1f-a9d6-75d8c22159ec tempest-VolumesActionsTest-383491166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e3df40e6-806a-4c1f-a9d6-75d8c22159ec tempest-VolumesActionsTest-383491166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e3df40e6-806a-4c1f-a9d6-75d8c22159ec tempest-VolumesActionsTest-383491166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:24:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e3df40e6-806a-4c1f-a9d6-75d8c22159ec tempest-VolumesActionsTest-383491166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:53 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:24:53 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:54 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f228d327-87a5-45b2-92cc-4cdc2c8ec143 1073741824" returned: 0 in 0.828s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f228d327-87a5-45b2-92cc-4cdc2c8ec143 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:54 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:54 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f228d327-87a5-45b2-92cc-4cdc2c8ec143 Nov 03 08:24:54 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e3df40e6-806a-4c1f-a9d6-75d8c22159ec tempest-VolumesActionsTest-383491166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.438s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:54 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-e3df40e6-806a-4c1f-a9d6-75d8c22159ec tempest-VolumesActionsTest-383491166 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:24:54 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-e3df40e6-806a-4c1f-a9d6-75d8c22159ec tempest-VolumesActionsTest-383491166 None] Deleted volume successfully. Nov 03 08:24:54 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e3df40e6-806a-4c1f-a9d6-75d8c22159ec tempest-VolumesActionsTest-383491166 None] Lock "cinder-c82d4837-1606-4b56-8139-146ee99aa1d4-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:24:54 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f228d327-87a5-45b2-92cc-4cdc2c8ec143" returned: 0 in 0.260s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:24:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:24:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e7b378-6704-47dd-a82c-cf7cf278be2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f228d327-87a5-45b2-92cc-4cdc2c8ec143', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20ff9ed-8a8f-4d9c-94f5-d6fec77c0028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:54 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Volume volume-f228d327-87a5-45b2-92cc-4cdc2c8ec143 (f228d327-87a5-45b2-92cc-4cdc2c8ec143): created successfully Nov 03 08:24:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20ff9ed-8a8f-4d9c-94f5-d6fec77c0028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Flow 'volume_create_manager' (7c74028e-8b08-4c6f-b5a8-f99b4dd1c68c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:24:54 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-a0fcf610-a766-492c-b95e-e70872f01d39 tempest-VolumesListAdminTestJSON-1201312565 None] Created volume successfully. Nov 03 08:24:56 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:24:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Flow 'volume_create_manager' (644ffa15-0841-4d71-aebb-9ec744b5b771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:24:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937fafa8-88b6-4e85-a32f-86789ce230f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937fafa8-88b6-4e85-a32f-86789ce230f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a054ada-17fb-4699-8a7c-2dcdca385cb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e26979e537b438ca564c609d12d6be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:24:56Z,use_quota=True,user_id='8d1cf15bd91742a5af2c5b29b8037a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e9c3876-facb-4a9d-94a9-46a8140c6ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e9c3876-facb-4a9d-94a9-46a8140c6ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c2aed8-ab6d-4cb1-99a2-53a37b096b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c2aed8-ab6d-4cb1-99a2-53a37b096b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a054ada-17fb-4699-8a7c-2dcdca385cb2', 'volume_name': 'volume-6a054ada-17fb-4699-8a7c-2dcdca385cb2', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761fe9cd-4cc0-47c3-bacd-9d0434ebffde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761fe9cd-4cc0-47c3-bacd-9d0434ebffde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013efad8-27f6-437d-8c25-56e62344e924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:56 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Volume 6a054ada-17fb-4699-8a7c-2dcdca385cb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a054ada-17fb-4699-8a7c-2dcdca385cb2', 'volume_size': 1} Nov 03 08:24:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:24:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:24:56 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a054ada-17fb-4699-8a7c-2dcdca385cb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e26979e537b438ca564c609d12d6be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:24:56Z,use_quota=True,user_id='8d1cf15bd91742a5af2c5b29b8037a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:24:56 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Creating volume 6a054ada-17fb-4699-8a7c-2dcdca385cb2 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:24:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:24:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:24:56 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:24:56 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:24:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:24:56 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:24:56 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:24:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6a054ada-17fb-4699-8a7c-2dcdca385cb2 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:56 devstack sudo[98436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6a054ada-17fb-4699-8a7c-2dcdca385cb2 1073741824 Nov 03 08:24:56 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:57 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6a054ada-17fb-4699-8a7c-2dcdca385cb2 1073741824" returned: 0 in 0.840s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6a054ada-17fb-4699-8a7c-2dcdca385cb2 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:57 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6a054ada-17fb-4699-8a7c-2dcdca385cb2 Nov 03 08:24:57 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:57 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6a054ada-17fb-4699-8a7c-2dcdca385cb2" returned: 0 in 0.289s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:57 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:24:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:24:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013efad8-27f6-437d-8c25-56e62344e924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a054ada-17fb-4699-8a7c-2dcdca385cb2', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75cc6bb-bea3-4e29-a303-1661749564e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:24:57 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Volume volume-6a054ada-17fb-4699-8a7c-2dcdca385cb2 (6a054ada-17fb-4699-8a7c-2dcdca385cb2): created successfully Nov 03 08:24:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75cc6bb-bea3-4e29-a303-1661749564e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:24:57 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Flow 'volume_create_manager' (644ffa15-0841-4d71-aebb-9ec744b5b771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:24:57 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-6bfa17ad-e305-47eb-b7e9-8ab50e943fcb tempest-VolumesListAdminTestJSON-2110489299 None] Created volume successfully. Nov 03 08:24:58 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-84fdbeb5-3a7f-4ea0-9831-f1b4ebc836ae tempest-VolumesListAdminTestJSON-2110489299 None] Acquiring lock "cinder-6a054ada-17fb-4699-8a7c-2dcdca385cb2-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:24:58 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-84fdbeb5-3a7f-4ea0-9831-f1b4ebc836ae tempest-VolumesListAdminTestJSON-2110489299 None] Lock "cinder-6a054ada-17fb-4699-8a7c-2dcdca385cb2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:24:58 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-84fdbeb5-3a7f-4ea0-9831-f1b4ebc836ae tempest-VolumesListAdminTestJSON-2110489299 None] Acquiring lock "cinder-quobyte-6a054ada-17fb-4699-8a7c-2dcdca385cb2" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:24:58 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-84fdbeb5-3a7f-4ea0-9831-f1b4ebc836ae tempest-VolumesListAdminTestJSON-2110489299 None] Lock "cinder-quobyte-6a054ada-17fb-4699-8a7c-2dcdca385cb2" acquired by "delete_volume" :: waited 0.021s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:24:58 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc88dc4-0be4-44ba-afb2-aa0b3ea516c9]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:24:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-84fdbeb5-3a7f-4ea0-9831-f1b4ebc836ae tempest-VolumesListAdminTestJSON-2110489299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6a054ada-17fb-4699-8a7c-2dcdca385cb2 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:58 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-73e0edab-d8ce-4f58-b855-35b334fff8a6 tempest-VolumesListAdminTestJSON-1201312565 None] Acquiring lock "cinder-f228d327-87a5-45b2-92cc-4cdc2c8ec143-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:24:58 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-73e0edab-d8ce-4f58-b855-35b334fff8a6 tempest-VolumesListAdminTestJSON-1201312565 None] Lock "cinder-f228d327-87a5-45b2-92cc-4cdc2c8ec143-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:24:58 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-73e0edab-d8ce-4f58-b855-35b334fff8a6 tempest-VolumesListAdminTestJSON-1201312565 None] Acquiring lock "cinder-quobyte-f228d327-87a5-45b2-92cc-4cdc2c8ec143" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:24:58 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-73e0edab-d8ce-4f58-b855-35b334fff8a6 tempest-VolumesListAdminTestJSON-1201312565 None] Lock "cinder-quobyte-f228d327-87a5-45b2-92cc-4cdc2c8ec143" acquired by "delete_volume" :: waited 0.034s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:24:58 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5f3618-0c29-4ed5-a67b-38aa2e4249a5]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:24:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-73e0edab-d8ce-4f58-b855-35b334fff8a6 tempest-VolumesListAdminTestJSON-1201312565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f228d327-87a5-45b2-92cc-4cdc2c8ec143 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:58 devstack sudo[98453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6a054ada-17fb-4699-8a7c-2dcdca385cb2 Nov 03 08:24:58 devstack sudo[98453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:58 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f228d327-87a5-45b2-92cc-4cdc2c8ec143 Nov 03 08:24:58 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:58 devstack sudo[98453]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-84fdbeb5-3a7f-4ea0-9831-f1b4ebc836ae tempest-VolumesListAdminTestJSON-2110489299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6a054ada-17fb-4699-8a7c-2dcdca385cb2" returned: 0 in 0.588s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-84fdbeb5-3a7f-4ea0-9831-f1b4ebc836ae tempest-VolumesListAdminTestJSON-2110489299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6a054ada-17fb-4699-8a7c-2dcdca385cb2 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:59 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6a054ada-17fb-4699-8a7c-2dcdca385cb2 Nov 03 08:24:59 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:59 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-73e0edab-d8ce-4f58-b855-35b334fff8a6 tempest-VolumesListAdminTestJSON-1201312565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f228d327-87a5-45b2-92cc-4cdc2c8ec143" returned: 0 in 0.886s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-73e0edab-d8ce-4f58-b855-35b334fff8a6 tempest-VolumesListAdminTestJSON-1201312565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f228d327-87a5-45b2-92cc-4cdc2c8ec143 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:59 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-84fdbeb5-3a7f-4ea0-9831-f1b4ebc836ae tempest-VolumesListAdminTestJSON-2110489299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6a054ada-17fb-4699-8a7c-2dcdca385cb2" returned: 0 in 0.538s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:59 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-84fdbeb5-3a7f-4ea0-9831-f1b4ebc836ae tempest-VolumesListAdminTestJSON-2110489299 None] Lock "cinder-quobyte-6a054ada-17fb-4699-8a7c-2dcdca385cb2" released by "delete_volume" :: held 1.212s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:24:59 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f228d327-87a5-45b2-92cc-4cdc2c8ec143 Nov 03 08:24:59 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:59 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-84fdbeb5-3a7f-4ea0-9831-f1b4ebc836ae tempest-VolumesListAdminTestJSON-2110489299 None] Created reservations ['ed9899ba-a431-4611-a63e-271f35aa5535', '616833e3-4297-4f88-8034-21704ff6f137', '5deb1465-a4be-4922-926c-02fb669e2b69', '05211ca5-15b0-4511-90e2-7b62b7b39000'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:24:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-84fdbeb5-3a7f-4ea0-9831-f1b4ebc836ae tempest-VolumesListAdminTestJSON-2110489299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:24:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-84fdbeb5-3a7f-4ea0-9831-f1b4ebc836ae tempest-VolumesListAdminTestJSON-2110489299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:24:59 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-84fdbeb5-3a7f-4ea0-9831-f1b4ebc836ae tempest-VolumesListAdminTestJSON-2110489299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:24:59 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-84fdbeb5-3a7f-4ea0-9831-f1b4ebc836ae tempest-VolumesListAdminTestJSON-2110489299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:24:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-84fdbeb5-3a7f-4ea0-9831-f1b4ebc836ae tempest-VolumesListAdminTestJSON-2110489299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:24:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-84fdbeb5-3a7f-4ea0-9831-f1b4ebc836ae tempest-VolumesListAdminTestJSON-2110489299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:24:59 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:24:59 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:24:59 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Nov 03 08:24:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-73e0edab-d8ce-4f58-b855-35b334fff8a6 tempest-VolumesListAdminTestJSON-1201312565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f228d327-87a5-45b2-92cc-4cdc2c8ec143" returned: 0 in 0.380s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:24:59 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-73e0edab-d8ce-4f58-b855-35b334fff8a6 tempest-VolumesListAdminTestJSON-1201312565 None] Lock "cinder-quobyte-f228d327-87a5-45b2-92cc-4cdc2c8ec143" released by "delete_volume" :: held 1.356s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:24:59 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-73e0edab-d8ce-4f58-b855-35b334fff8a6 tempest-VolumesListAdminTestJSON-1201312565 None] Created reservations ['e4c8a06f-91dc-4b58-8546-d371449114c5', '8f1e5069-4626-4b64-acfa-239ba0d0de08', '16f1788f-281d-4117-8f1f-ab6a0e690ebc', '62c3255e-dbde-48ee-90e8-b1b79cb93747'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:25:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-73e0edab-d8ce-4f58-b855-35b334fff8a6 tempest-VolumesListAdminTestJSON-1201312565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-73e0edab-d8ce-4f58-b855-35b334fff8a6 tempest-VolumesListAdminTestJSON-1201312565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-73e0edab-d8ce-4f58-b855-35b334fff8a6 tempest-VolumesListAdminTestJSON-1201312565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:25:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-73e0edab-d8ce-4f58-b855-35b334fff8a6 tempest-VolumesListAdminTestJSON-1201312565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:25:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-73e0edab-d8ce-4f58-b855-35b334fff8a6 tempest-VolumesListAdminTestJSON-1201312565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-73e0edab-d8ce-4f58-b855-35b334fff8a6 tempest-VolumesListAdminTestJSON-1201312565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:00 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:25:00 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:00 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-84fdbeb5-3a7f-4ea0-9831-f1b4ebc836ae tempest-VolumesListAdminTestJSON-2110489299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.579s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:00 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-84fdbeb5-3a7f-4ea0-9831-f1b4ebc836ae tempest-VolumesListAdminTestJSON-2110489299 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:25:00 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-84fdbeb5-3a7f-4ea0-9831-f1b4ebc836ae tempest-VolumesListAdminTestJSON-2110489299 None] Deleted volume successfully. Nov 03 08:25:00 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-84fdbeb5-3a7f-4ea0-9831-f1b4ebc836ae tempest-VolumesListAdminTestJSON-2110489299 None] Lock "cinder-6a054ada-17fb-4699-8a7c-2dcdca385cb2-delete_volume" released by "delete_volume" :: held 2.170s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:25:00 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-73e0edab-d8ce-4f58-b855-35b334fff8a6 tempest-VolumesListAdminTestJSON-1201312565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.538s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:00 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-73e0edab-d8ce-4f58-b855-35b334fff8a6 tempest-VolumesListAdminTestJSON-1201312565 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:25:00 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-73e0edab-d8ce-4f58-b855-35b334fff8a6 tempest-VolumesListAdminTestJSON-1201312565 None] Deleted volume successfully. Nov 03 08:25:00 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-73e0edab-d8ce-4f58-b855-35b334fff8a6 tempest-VolumesListAdminTestJSON-1201312565 None] Lock "cinder-f228d327-87a5-45b2-92cc-4cdc2c8ec143-delete_volume" released by "delete_volume" :: held 2.342s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:25:00 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1d855196-18cc-422c-92be-8f731e25e87e tempest-VolumesListAdminTestJSON-1201312565 None] Acquiring lock "cinder-6556f099-9962-45b4-bfc3-6014db927f1b-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:25:00 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1d855196-18cc-422c-92be-8f731e25e87e tempest-VolumesListAdminTestJSON-1201312565 None] Lock "cinder-6556f099-9962-45b4-bfc3-6014db927f1b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:25:00 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1d855196-18cc-422c-92be-8f731e25e87e tempest-VolumesListAdminTestJSON-1201312565 None] Acquiring lock "cinder-quobyte-6556f099-9962-45b4-bfc3-6014db927f1b" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:25:00 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1d855196-18cc-422c-92be-8f731e25e87e tempest-VolumesListAdminTestJSON-1201312565 None] Lock "cinder-quobyte-6556f099-9962-45b4-bfc3-6014db927f1b" acquired by "delete_volume" :: waited 0.032s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:25:01 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[e971a873-5290-45a3-88f0-a30d43c05aba]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:25:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1d855196-18cc-422c-92be-8f731e25e87e tempest-VolumesListAdminTestJSON-1201312565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6556f099-9962-45b4-bfc3-6014db927f1b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:01 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6556f099-9962-45b4-bfc3-6014db927f1b Nov 03 08:25:01 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:01 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1d855196-18cc-422c-92be-8f731e25e87e tempest-VolumesListAdminTestJSON-1201312565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6556f099-9962-45b4-bfc3-6014db927f1b" returned: 0 in 0.500s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1d855196-18cc-422c-92be-8f731e25e87e tempest-VolumesListAdminTestJSON-1201312565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6556f099-9962-45b4-bfc3-6014db927f1b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:01 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6556f099-9962-45b4-bfc3-6014db927f1b Nov 03 08:25:01 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:01 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1d855196-18cc-422c-92be-8f731e25e87e tempest-VolumesListAdminTestJSON-1201312565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6556f099-9962-45b4-bfc3-6014db927f1b" returned: 0 in 0.283s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1d855196-18cc-422c-92be-8f731e25e87e tempest-VolumesListAdminTestJSON-1201312565 None] Lock "cinder-quobyte-6556f099-9962-45b4-bfc3-6014db927f1b" released by "delete_volume" :: held 0.859s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:25:01 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-1d855196-18cc-422c-92be-8f731e25e87e tempest-VolumesListAdminTestJSON-1201312565 None] Created reservations ['8b90b34a-9603-4628-9625-a2b79677f383', 'e5916737-ed9e-4b2b-ba41-c762aa847afb', '5fe414f4-9d94-4907-93ef-e96f5037704a', '2d047cf3-4df3-4580-801d-24d5a72333d9'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:25:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1d855196-18cc-422c-92be-8f731e25e87e tempest-VolumesListAdminTestJSON-1201312565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1d855196-18cc-422c-92be-8f731e25e87e tempest-VolumesListAdminTestJSON-1201312565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:02 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1d855196-18cc-422c-92be-8f731e25e87e tempest-VolumesListAdminTestJSON-1201312565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:25:02 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1d855196-18cc-422c-92be-8f731e25e87e tempest-VolumesListAdminTestJSON-1201312565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:25:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1d855196-18cc-422c-92be-8f731e25e87e tempest-VolumesListAdminTestJSON-1201312565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1d855196-18cc-422c-92be-8f731e25e87e tempest-VolumesListAdminTestJSON-1201312565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:02 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:25:02 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:02 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-865a2f8c-294f-411c-a1e7-cb1c45f9fc4e tempest-VolumesListAdminTestJSON-1201312565 None] Acquiring lock "cinder-620ad3e9-3523-42fe-ac2e-b8b31784cdc6-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:25:02 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-865a2f8c-294f-411c-a1e7-cb1c45f9fc4e tempest-VolumesListAdminTestJSON-1201312565 None] Lock "cinder-620ad3e9-3523-42fe-ac2e-b8b31784cdc6-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:25:02 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-865a2f8c-294f-411c-a1e7-cb1c45f9fc4e tempest-VolumesListAdminTestJSON-1201312565 None] Acquiring lock "cinder-quobyte-620ad3e9-3523-42fe-ac2e-b8b31784cdc6" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:25:02 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-865a2f8c-294f-411c-a1e7-cb1c45f9fc4e tempest-VolumesListAdminTestJSON-1201312565 None] Lock "cinder-quobyte-620ad3e9-3523-42fe-ac2e-b8b31784cdc6" acquired by "delete_volume" :: waited 0.024s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:25:02 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[c502e237-11df-4f6e-93ab-d01e3caac6db]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:25:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-865a2f8c-294f-411c-a1e7-cb1c45f9fc4e tempest-VolumesListAdminTestJSON-1201312565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-620ad3e9-3523-42fe-ac2e-b8b31784cdc6 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:02 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1d855196-18cc-422c-92be-8f731e25e87e tempest-VolumesListAdminTestJSON-1201312565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.427s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:02 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-1d855196-18cc-422c-92be-8f731e25e87e tempest-VolumesListAdminTestJSON-1201312565 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:25:02 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-1d855196-18cc-422c-92be-8f731e25e87e tempest-VolumesListAdminTestJSON-1201312565 None] Deleted volume successfully. Nov 03 08:25:02 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1d855196-18cc-422c-92be-8f731e25e87e tempest-VolumesListAdminTestJSON-1201312565 None] Lock "cinder-6556f099-9962-45b4-bfc3-6014db927f1b-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:25:02 devstack sudo[98491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-620ad3e9-3523-42fe-ac2e-b8b31784cdc6 Nov 03 08:25:02 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:02 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-865a2f8c-294f-411c-a1e7-cb1c45f9fc4e tempest-VolumesListAdminTestJSON-1201312565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-620ad3e9-3523-42fe-ac2e-b8b31784cdc6" returned: 0 in 0.469s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-865a2f8c-294f-411c-a1e7-cb1c45f9fc4e tempest-VolumesListAdminTestJSON-1201312565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-620ad3e9-3523-42fe-ac2e-b8b31784cdc6 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:02 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-620ad3e9-3523-42fe-ac2e-b8b31784cdc6 Nov 03 08:25:02 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:03 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-865a2f8c-294f-411c-a1e7-cb1c45f9fc4e tempest-VolumesListAdminTestJSON-1201312565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-620ad3e9-3523-42fe-ac2e-b8b31784cdc6" returned: 0 in 0.284s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-865a2f8c-294f-411c-a1e7-cb1c45f9fc4e tempest-VolumesListAdminTestJSON-1201312565 None] Lock "cinder-quobyte-620ad3e9-3523-42fe-ac2e-b8b31784cdc6" released by "delete_volume" :: held 0.807s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:25:03 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-865a2f8c-294f-411c-a1e7-cb1c45f9fc4e tempest-VolumesListAdminTestJSON-1201312565 None] Created reservations ['0b8d6f9a-4a91-422a-bdec-ca04960a74ea', 'af821d89-06a5-4371-8aa2-7dc43b3f4175', '8d4ce2c6-2af5-44f4-b72d-c657d84bd664', '7004c505-baa4-4598-addd-2fae6bd7e48b'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:25:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-865a2f8c-294f-411c-a1e7-cb1c45f9fc4e tempest-VolumesListAdminTestJSON-1201312565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-865a2f8c-294f-411c-a1e7-cb1c45f9fc4e tempest-VolumesListAdminTestJSON-1201312565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-865a2f8c-294f-411c-a1e7-cb1c45f9fc4e tempest-VolumesListAdminTestJSON-1201312565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:25:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-865a2f8c-294f-411c-a1e7-cb1c45f9fc4e tempest-VolumesListAdminTestJSON-1201312565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:25:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-865a2f8c-294f-411c-a1e7-cb1c45f9fc4e tempest-VolumesListAdminTestJSON-1201312565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-865a2f8c-294f-411c-a1e7-cb1c45f9fc4e tempest-VolumesListAdminTestJSON-1201312565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:03 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:25:03 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:03 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-865a2f8c-294f-411c-a1e7-cb1c45f9fc4e tempest-VolumesListAdminTestJSON-1201312565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.330s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:03 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-865a2f8c-294f-411c-a1e7-cb1c45f9fc4e tempest-VolumesListAdminTestJSON-1201312565 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:25:03 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-865a2f8c-294f-411c-a1e7-cb1c45f9fc4e tempest-VolumesListAdminTestJSON-1201312565 None] Deleted volume successfully. Nov 03 08:25:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-865a2f8c-294f-411c-a1e7-cb1c45f9fc4e tempest-VolumesListAdminTestJSON-1201312565 None] Lock "cinder-620ad3e9-3523-42fe-ac2e-b8b31784cdc6-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:25:03 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:25:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:25:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:25:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:03 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:25:03 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:04 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.332s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:04 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:25:04 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager._thread_info {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:25:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread count: 29 {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 08:25:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread info: [<_MainThread(MainThread, started 139707544170624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 08:25:05 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:25:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Flow 'volume_create_manager' (956764b3-29c4-4dbe-b72f-f23cbcee1615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:25:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84778ac7-72cd-4821-9e48-4c324e0e7952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84778ac7-72cd-4821-9e48-4c324e0e7952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-564380647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b2ba869-f11a-48ae-a075-fa92bbc6854d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcaf8cd7d28d4db9963ed9eababf2270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:25:05Z,use_quota=True,user_id='f5f4bf3b56824429a0ee12cc7ffccb31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abdf3df-0ab8-4411-b9d1-80b6fa093879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abdf3df-0ab8-4411-b9d1-80b6fa093879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a21e155-35ec-4689-b601-d7522b8c406f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:05 devstack cinder-volume[86801]: DEBUG cinder.image.glance [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Creating Keystone auth plugin from conf {{(pid=86801) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 08:25:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a21e155-35ec-4689-b601-d7522b8c406f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9b2ba869-f11a-48ae-a075-fa92bbc6854d', 'volume_name': 'volume-9b2ba869-f11a-48ae-a075-fa92bbc6854d', 'volume_size': 1, 'image_id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02c779626a284994918db1738b55fe79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'created_at': datetime.datetime(2026, 11, 3, 7, 8, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 8, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9eb5e936-be4c-46be-8de8-899e9fc38d33/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c621a27c-86fb-4ed9-8441-5a611167095b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c621a27c-86fb-4ed9-8441-5a611167095b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad31eb5-3627-4391-a886-717f0a416278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:05 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Volume 9b2ba869-f11a-48ae-a075-fa92bbc6854d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9b2ba869-f11a-48ae-a075-fa92bbc6854d', 'volume_size': 1, 'image_id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02c779626a284994918db1738b55fe79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'created_at': datetime.datetime(2026, 11, 3, 7, 8, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 8, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9eb5e936-be4c-46be-8de8-899e9fc38d33/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 08:25:05 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Trying to clone 9b2ba869-f11a-48ae-a075-fa92bbc6854d from image 9eb5e936-be4c-46be-8de8-899e9fc38d33 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}]). {{(pid=86801) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 08:25:06 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_ip3k_o_pdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 08:25:06 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Image download 20.69 MB at 20.69 MB/s Nov 03 08:25:06 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbcbd26-f24a-40c5-9db9-54d65859b5f9]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:25:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_ip3k_o_pdevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:06 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_ip3k_o_pdevstack@QuobyteHD Nov 03 08:25:06 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:06 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_ip3k_o_pdevstack@QuobyteHD" returned: 0 in 0.406s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:07 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Temporary image 9eb5e936-be4c-46be-8de8-899e9fc38d33 is fetched for user f5f4bf3b56824429a0ee12cc7ffccb31. {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 08:25:07 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdc3a78-d7ce-4049-9801-7ce2abb0a3a3]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:25:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_ip3k_o_pdevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:07 devstack sudo[98905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_ip3k_o_pdevstack@QuobyteHD Nov 03 08:25:07 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:07 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_ip3k_o_pdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:07 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-564380647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b2ba869-f11a-48ae-a075-fa92bbc6854d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcaf8cd7d28d4db9963ed9eababf2270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:25:05Z,use_quota=True,user_id='f5f4bf3b56824429a0ee12cc7ffccb31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:25:07 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Creating volume 9b2ba869-f11a-48ae-a075-fa92bbc6854d {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:25:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:07 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:25:07 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:25:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:07 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:25:07 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:25:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b2ba869-f11a-48ae-a075-fa92bbc6854d 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:07 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b2ba869-f11a-48ae-a075-fa92bbc6854d 1073741824 Nov 03 08:25:07 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:07 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b2ba869-f11a-48ae-a075-fa92bbc6854d 1073741824" returned: 0 in 0.449s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b2ba869-f11a-48ae-a075-fa92bbc6854d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:07 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b2ba869-f11a-48ae-a075-fa92bbc6854d Nov 03 08:25:07 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:08 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b2ba869-f11a-48ae-a075-fa92bbc6854d" returned: 0 in 0.250s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:08 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:25:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:08 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Attempting download of 9eb5e936-be4c-46be-8de8-899e9fc38d33 ((None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}])) to volume 9b2ba869-f11a-48ae-a075-fa92bbc6854d. {{(pid=86801) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 08:25:08 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[36619abc-5c01-4126-89f5-b890423b6f48]: (4, 'raw') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:25:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_u_irprjj {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:08 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_u_irprjj Nov 03 08:25:08 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:08 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_u_irprjj" returned: 0 in 0.346s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_u_irprjj {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:08 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_u_irprjj Nov 03 08:25:08 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:08 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_u_irprjj" returned: 1 in 0.341s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_u_irprjj' failed. Not Retrying. {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 08:25:08 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4e0df8-0829-40b2-a84e-a03fb11c2fa5]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:25:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_ip3k_o_pdevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:09 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_ip3k_o_pdevstack@QuobyteHD Nov 03 08:25:09 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:09 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_ip3k_o_pdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:09 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] 9eb5e936-be4c-46be-8de8-899e9fc38d33 was qcow2, converting to qcow2 {{(pid=86801) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 08:25:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_ip3k_o_pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b2ba869-f11a-48ae-a075-fa92bbc6854d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:09 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_ip3k_o_pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b2ba869-f11a-48ae-a075-fa92bbc6854d Nov 03 08:25:09 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:11 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_ip3k_o_pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b2ba869-f11a-48ae-a075-fa92bbc6854d" returned: 0 in 1.861s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:11 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_ip3k_o_pdevstack@QuobyteHD, size 112.00 MB, duration 1.86 sec, destination /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b2ba869-f11a-48ae-a075-fa92bbc6854d {{(pid=86801) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 08:25:11 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Converted 112.00 MB image at 60.12 MB/s Nov 03 08:25:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b2ba869-f11a-48ae-a075-fa92bbc6854d 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:11 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b2ba869-f11a-48ae-a075-fa92bbc6854d 1G Nov 03 08:25:11 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:11 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b2ba869-f11a-48ae-a075-fa92bbc6854d 1G" returned: 0 in 0.303s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:11 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Downloaded image 9eb5e936-be4c-46be-8de8-899e9fc38d33 ((None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}])) to volume 9b2ba869-f11a-48ae-a075-fa92bbc6854d successfully. {{(pid=86801) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 08:25:11 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Temporary image 9eb5e936-be4c-46be-8de8-899e9fc38d33 for user f5f4bf3b56824429a0ee12cc7ffccb31 is deleted. {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 08:25:11 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Marking volume 9b2ba869-f11a-48ae-a075-fa92bbc6854d as bootable. {{(pid=86801) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 08:25:11 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Copying metadata from image 9eb5e936-be4c-46be-8de8-899e9fc38d33 to 9b2ba869-f11a-48ae-a075-fa92bbc6854d. {{(pid=86801) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 08:25:11 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Creating volume glance metadata for volume 9b2ba869-f11a-48ae-a075-fa92bbc6854d backed by image 9eb5e936-be4c-46be-8de8-899e9fc38d33 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86801) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 08:25:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad31eb5-3627-4391-a886-717f0a416278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b2ba869-f11a-48ae-a075-fa92bbc6854d', 'volume_size': 1, 'image_id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02c779626a284994918db1738b55fe79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'created_at': datetime.datetime(2026, 11, 3, 7, 8, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 8, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9eb5e936-be4c-46be-8de8-899e9fc38d33/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c0fe6c0-0b2e-4616-9362-36daa4cf8873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:11 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Volume volume-9b2ba869-f11a-48ae-a075-fa92bbc6854d (9b2ba869-f11a-48ae-a075-fa92bbc6854d): created successfully Nov 03 08:25:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c0fe6c0-0b2e-4616-9362-36daa4cf8873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Flow 'volume_create_manager' (956764b3-29c4-4dbe-b72f-f23cbcee1615) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:25:11 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-ac5f82b5-6624-4963-a7a1-dd64115927e2 tempest-VolumesExtendTest-1685417042 None] Created volume successfully. Nov 03 08:25:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2f8fab47-ba65-4de0-a7e2-b00455f618f5 tempest-VolumesExtendTest-1685417042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2f8fab47-ba65-4de0-a7e2-b00455f618f5 tempest-VolumesExtendTest-1685417042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:12 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab50edb-8cd8-4747-a4e9-863a777a36bd]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:25:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2f8fab47-ba65-4de0-a7e2-b00455f618f5 tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b2ba869-f11a-48ae-a075-fa92bbc6854d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:13 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b2ba869-f11a-48ae-a075-fa92bbc6854d Nov 03 08:25:13 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:13 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2f8fab47-ba65-4de0-a7e2-b00455f618f5 tempest-VolumesExtendTest-1685417042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b2ba869-f11a-48ae-a075-fa92bbc6854d" returned: 0 in 0.388s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2f8fab47-ba65-4de0-a7e2-b00455f618f5 tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b2ba869-f11a-48ae-a075-fa92bbc6854d 2G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2f8fab47-ba65-4de0-a7e2-b00455f618f5 tempest-VolumesExtendTest-1685417042 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b2ba869-f11a-48ae-a075-fa92bbc6854d 2G" returned: 0 in 0.104s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2f8fab47-ba65-4de0-a7e2-b00455f618f5 tempest-VolumesExtendTest-1685417042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.521s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:13 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-2f8fab47-ba65-4de0-a7e2-b00455f618f5 tempest-VolumesExtendTest-1685417042 None] Extend volume completed successfully. Nov 03 08:25:13 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:25:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Flow 'volume_create_manager' (2e210048-713c-4845-aa9c-3826db84133c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:25:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27973c25-4583-46a5-a775-0d3ccb449f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27973c25-4583-46a5-a775-0d3ccb449f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1790545677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e95e116-32bb-4040-80b1-1affa78724b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08dfefd450414735b44210c1162a745d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:25:14Z,use_quota=True,user_id='c662ef8aa02e46099d577ed8a4195cfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68de26b2-6dd9-40d7-9a6c-23540464b7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68de26b2-6dd9-40d7-9a6c-23540464b7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2868adea-f396-4441-af9d-bd7f110af9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2868adea-f396-4441-af9d-bd7f110af9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e95e116-32bb-4040-80b1-1affa78724b4', 'volume_name': 'volume-0e95e116-32bb-4040-80b1-1affa78724b4', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a93f5b54-efd5-42b3-855d-6e66fcb88806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a93f5b54-efd5-42b3-855d-6e66fcb88806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dac2490-6f08-4530-be5d-823b87f43845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:13 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Volume 0e95e116-32bb-4040-80b1-1affa78724b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e95e116-32bb-4040-80b1-1affa78724b4', 'volume_size': 1} Nov 03 08:25:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:13 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1790545677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e95e116-32bb-4040-80b1-1affa78724b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08dfefd450414735b44210c1162a745d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:25:14Z,use_quota=True,user_id='c662ef8aa02e46099d577ed8a4195cfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:25:13 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Creating volume 0e95e116-32bb-4040-80b1-1affa78724b4 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:25:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:13 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:25:14 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:25:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:14 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:25:14 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:25:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0e95e116-32bb-4040-80b1-1affa78724b4 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:14 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0e95e116-32bb-4040-80b1-1affa78724b4 1073741824 Nov 03 08:25:14 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:14 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-167c7cdc-a928-40cc-921b-762fd9b8b2aa tempest-VolumesExtendTest-1685417042 None] Acquiring lock "cinder-9b2ba869-f11a-48ae-a075-fa92bbc6854d-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:25:14 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-167c7cdc-a928-40cc-921b-762fd9b8b2aa tempest-VolumesExtendTest-1685417042 None] Lock "cinder-9b2ba869-f11a-48ae-a075-fa92bbc6854d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:25:14 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-167c7cdc-a928-40cc-921b-762fd9b8b2aa tempest-VolumesExtendTest-1685417042 None] Acquiring lock "cinder-quobyte-9b2ba869-f11a-48ae-a075-fa92bbc6854d" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:25:14 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-167c7cdc-a928-40cc-921b-762fd9b8b2aa tempest-VolumesExtendTest-1685417042 None] Lock "cinder-quobyte-9b2ba869-f11a-48ae-a075-fa92bbc6854d" acquired by "delete_volume" :: waited 0.016s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:25:14 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3295d1-e37d-4922-a4fd-927370c55751]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:25:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-167c7cdc-a928-40cc-921b-762fd9b8b2aa tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b2ba869-f11a-48ae-a075-fa92bbc6854d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:14 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0e95e116-32bb-4040-80b1-1affa78724b4 1073741824" returned: 0 in 0.559s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:14 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b2ba869-f11a-48ae-a075-fa92bbc6854d Nov 03 08:25:14 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0e95e116-32bb-4040-80b1-1affa78724b4 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:14 devstack sudo[99056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0e95e116-32bb-4040-80b1-1affa78724b4 Nov 03 08:25:14 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:14 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-167c7cdc-a928-40cc-921b-762fd9b8b2aa tempest-VolumesExtendTest-1685417042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b2ba869-f11a-48ae-a075-fa92bbc6854d" returned: 0 in 0.442s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-167c7cdc-a928-40cc-921b-762fd9b8b2aa tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b2ba869-f11a-48ae-a075-fa92bbc6854d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:14 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0e95e116-32bb-4040-80b1-1affa78724b4" returned: 0 in 0.299s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:14 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:25:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:14 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b2ba869-f11a-48ae-a075-fa92bbc6854d Nov 03 08:25:14 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dac2490-6f08-4530-be5d-823b87f43845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e95e116-32bb-4040-80b1-1affa78724b4', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85159c6f-af3d-4b71-94a9-1243fb74b77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:14 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Volume volume-0e95e116-32bb-4040-80b1-1affa78724b4 (0e95e116-32bb-4040-80b1-1affa78724b4): created successfully Nov 03 08:25:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85159c6f-af3d-4b71-94a9-1243fb74b77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Flow 'volume_create_manager' (2e210048-713c-4845-aa9c-3826db84133c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:25:14 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-391d605a-17d4-42c2-aa13-6fdda4f47561 tempest-VolumesTransfersTest-1164558466 None] Created volume successfully. Nov 03 08:25:15 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-167c7cdc-a928-40cc-921b-762fd9b8b2aa tempest-VolumesExtendTest-1685417042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b2ba869-f11a-48ae-a075-fa92bbc6854d" returned: 0 in 0.262s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:15 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-167c7cdc-a928-40cc-921b-762fd9b8b2aa tempest-VolumesExtendTest-1685417042 None] Lock "cinder-quobyte-9b2ba869-f11a-48ae-a075-fa92bbc6854d" released by "delete_volume" :: held 0.746s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:25:15 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-167c7cdc-a928-40cc-921b-762fd9b8b2aa tempest-VolumesExtendTest-1685417042 None] Created reservations ['65e4bb64-9431-497f-9229-60ba347216ac', 'a92c2465-8888-4a72-a8c9-ea2db2dc301e', 'd13c656d-73ca-42b7-bbb8-0ac77eca379f', '3affccc7-0a34-47f1-a0c1-062bfb2418db'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:25:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-167c7cdc-a928-40cc-921b-762fd9b8b2aa tempest-VolumesExtendTest-1685417042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-167c7cdc-a928-40cc-921b-762fd9b8b2aa tempest-VolumesExtendTest-1685417042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:15 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-167c7cdc-a928-40cc-921b-762fd9b8b2aa tempest-VolumesExtendTest-1685417042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:25:15 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-167c7cdc-a928-40cc-921b-762fd9b8b2aa tempest-VolumesExtendTest-1685417042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:25:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-167c7cdc-a928-40cc-921b-762fd9b8b2aa tempest-VolumesExtendTest-1685417042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-167c7cdc-a928-40cc-921b-762fd9b8b2aa tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:15 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:25:15 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:15 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-167c7cdc-a928-40cc-921b-762fd9b8b2aa tempest-VolumesExtendTest-1685417042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.245s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:15 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-167c7cdc-a928-40cc-921b-762fd9b8b2aa tempest-VolumesExtendTest-1685417042 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:25:15 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-167c7cdc-a928-40cc-921b-762fd9b8b2aa tempest-VolumesExtendTest-1685417042 None] Deleted volume successfully. Nov 03 08:25:15 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-167c7cdc-a928-40cc-921b-762fd9b8b2aa tempest-VolumesExtendTest-1685417042 None] Lock "cinder-9b2ba869-f11a-48ae-a075-fa92bbc6854d-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:25:15 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Flow 'volume_create_manager' (7a46864c-f226-4863-9809-94267182a6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (628769bc-e1dd-47c6-b1bb-2f6c01a8ddfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (628769bc-e1dd-47c6-b1bb-2f6c01a8ddfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-437110102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=288d58df-8df8-4473-a88e-d284e4cc9933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcaf8cd7d28d4db9963ed9eababf2270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:25:16Z,use_quota=True,user_id='f5f4bf3b56824429a0ee12cc7ffccb31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee0729c-e242-41bb-9978-bb8b597fb7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee0729c-e242-41bb-9978-bb8b597fb7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd1811c-ed2e-426d-a456-c423ddacbffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd1811c-ed2e-426d-a456-c423ddacbffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '288d58df-8df8-4473-a88e-d284e4cc9933', 'volume_name': 'volume-288d58df-8df8-4473-a88e-d284e4cc9933', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3fd899b-cc14-43bc-8fb6-5bd7645d7227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3fd899b-cc14-43bc-8fb6-5bd7645d7227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9f7aea-f4d6-41e9-b67e-3e36a2fe380f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:16 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Volume 288d58df-8df8-4473-a88e-d284e4cc9933: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-288d58df-8df8-4473-a88e-d284e4cc9933', 'volume_size': 1} Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-437110102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=288d58df-8df8-4473-a88e-d284e4cc9933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcaf8cd7d28d4db9963ed9eababf2270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:25:16Z,use_quota=True,user_id='f5f4bf3b56824429a0ee12cc7ffccb31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Creating volume 288d58df-8df8-4473-a88e-d284e4cc9933 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:25:16 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:16 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933 1073741824 Nov 03 08:25:16 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:16 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933 1073741824" returned: 0 in 0.500s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:16 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933 Nov 03 08:25:16 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:16 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-37342d16-845a-4900-8fa6-f3645f8dca51 tempest-VolumesTransfersTest-816211703 None] Transfer volume completed successfully. Nov 03 08:25:16 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933" returned: 0 in 0.286s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9f7aea-f4d6-41e9-b67e-3e36a2fe380f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-288d58df-8df8-4473-a88e-d284e4cc9933', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (701aa8c0-a855-4278-805e-7cce60bd5d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:16 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Volume volume-288d58df-8df8-4473-a88e-d284e4cc9933 (288d58df-8df8-4473-a88e-d284e4cc9933): created successfully Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (701aa8c0-a855-4278-805e-7cce60bd5d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Flow 'volume_create_manager' (7a46864c-f226-4863-9809-94267182a6c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:25:16 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-4d47bf87-e661-4dc6-865e-6d41c2500390 tempest-VolumesExtendTest-1685417042 None] Created volume successfully. Nov 03 08:25:17 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d4e49402-f12c-4112-a540-d1422e1e3138 tempest-VolumesTransfersTest-1641114865 None] Acquiring lock "cinder-0e95e116-32bb-4040-80b1-1affa78724b4-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:25:17 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d4e49402-f12c-4112-a540-d1422e1e3138 tempest-VolumesTransfersTest-1641114865 None] Lock "cinder-0e95e116-32bb-4040-80b1-1affa78724b4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:25:17 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d4e49402-f12c-4112-a540-d1422e1e3138 tempest-VolumesTransfersTest-1641114865 None] Acquiring lock "cinder-quobyte-0e95e116-32bb-4040-80b1-1affa78724b4" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:25:17 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d4e49402-f12c-4112-a540-d1422e1e3138 tempest-VolumesTransfersTest-1641114865 None] Lock "cinder-quobyte-0e95e116-32bb-4040-80b1-1affa78724b4" acquired by "delete_volume" :: waited 0.014s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:25:17 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af46b24-d793-4288-87c9-78de2b3a54c9]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:25:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d4e49402-f12c-4112-a540-d1422e1e3138 tempest-VolumesTransfersTest-1641114865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0e95e116-32bb-4040-80b1-1affa78724b4 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:17 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0e95e116-32bb-4040-80b1-1affa78724b4 Nov 03 08:25:17 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:17 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d4e49402-f12c-4112-a540-d1422e1e3138 tempest-VolumesTransfersTest-1641114865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0e95e116-32bb-4040-80b1-1affa78724b4" returned: 0 in 0.358s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d4e49402-f12c-4112-a540-d1422e1e3138 tempest-VolumesTransfersTest-1641114865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0e95e116-32bb-4040-80b1-1affa78724b4 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:17 devstack sudo[99082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0e95e116-32bb-4040-80b1-1affa78724b4 Nov 03 08:25:17 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:17 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d4e49402-f12c-4112-a540-d1422e1e3138 tempest-VolumesTransfersTest-1641114865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0e95e116-32bb-4040-80b1-1affa78724b4" returned: 0 in 0.247s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:17 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d4e49402-f12c-4112-a540-d1422e1e3138 tempest-VolumesTransfersTest-1641114865 None] Lock "cinder-quobyte-0e95e116-32bb-4040-80b1-1affa78724b4" released by "delete_volume" :: held 0.645s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:25:18 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-d4e49402-f12c-4112-a540-d1422e1e3138 tempest-VolumesTransfersTest-1641114865 None] Created reservations ['e957e0f6-e168-4567-9471-a4a910480ee7', '4dd64feb-85ef-40ac-95af-8c8142be84d0', '601b335a-04bc-436c-831a-38c905b9a305', 'f38c9306-5057-40d3-810a-7dac5cb18dae'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:25:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d4e49402-f12c-4112-a540-d1422e1e3138 tempest-VolumesTransfersTest-1641114865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d4e49402-f12c-4112-a540-d1422e1e3138 tempest-VolumesTransfersTest-1641114865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:18 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d4e49402-f12c-4112-a540-d1422e1e3138 tempest-VolumesTransfersTest-1641114865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:25:18 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d4e49402-f12c-4112-a540-d1422e1e3138 tempest-VolumesTransfersTest-1641114865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:25:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d4e49402-f12c-4112-a540-d1422e1e3138 tempest-VolumesTransfersTest-1641114865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d4e49402-f12c-4112-a540-d1422e1e3138 tempest-VolumesTransfersTest-1641114865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:18 devstack sudo[99085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:25:18 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8cae2c35-70fc-4a6d-9a60-59bfd681865c tempest-VolumesExtendTest-1685417042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8cae2c35-70fc-4a6d-9a60-59bfd681865c tempest-VolumesExtendTest-1685417042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:18 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-8cae2c35-70fc-4a6d-9a60-59bfd681865c tempest-VolumesExtendTest-1685417042 None] Creating offline snapshot 9fb9fcbd-5165-4e70-a618-e62a484301d8 of volume 288d58df-8df8-4473-a88e-d284e4cc9933 {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:25:18 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f83e087-3d2a-46d7-a9e6-06c9062cf02b]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:25:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8cae2c35-70fc-4a6d-9a60-59bfd681865c tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:18 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933 Nov 03 08:25:18 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:18 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d4e49402-f12c-4112-a540-d1422e1e3138 tempest-VolumesTransfersTest-1641114865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.274s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:18 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-d4e49402-f12c-4112-a540-d1422e1e3138 tempest-VolumesTransfersTest-1641114865 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:25:18 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-d4e49402-f12c-4112-a540-d1422e1e3138 tempest-VolumesTransfersTest-1641114865 None] Deleted volume successfully. Nov 03 08:25:18 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d4e49402-f12c-4112-a540-d1422e1e3138 tempest-VolumesTransfersTest-1641114865 None] Lock "cinder-0e95e116-32bb-4040-80b1-1affa78724b4-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:25:18 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8cae2c35-70fc-4a6d-9a60-59bfd681865c tempest-VolumesExtendTest-1685417042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933" returned: 0 in 0.398s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8cae2c35-70fc-4a6d-9a60-59bfd681865c tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933.9fb9fcbd-5165-4e70-a618-e62a484301d8 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:18 devstack sudo[99093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933.9fb9fcbd-5165-4e70-a618-e62a484301d8 1G Nov 03 08:25:18 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:18 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:25:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Flow 'volume_create_manager' (d4bce1c1-9104-461a-92b4-ab52b4521f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:25:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c001b6-1fdc-44f9-b2a0-97c415abee0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c001b6-1fdc-44f9-b2a0-97c415abee0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-538400812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a1d5984-449f-405b-b2de-49b97952b87c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08dfefd450414735b44210c1162a745d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:25:19Z,use_quota=True,user_id='c662ef8aa02e46099d577ed8a4195cfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc9a9c6-acfa-4983-bfb7-d560c2d9f19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc9a9c6-acfa-4983-bfb7-d560c2d9f19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2347d9f9-1943-4977-8144-48ba680a790c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2347d9f9-1943-4977-8144-48ba680a790c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a1d5984-449f-405b-b2de-49b97952b87c', 'volume_name': 'volume-0a1d5984-449f-405b-b2de-49b97952b87c', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d06b88-2472-42b7-b490-c8eefac2d9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d06b88-2472-42b7-b490-c8eefac2d9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ba5447-d3bb-4392-994f-2ff8fada3b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:19 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Volume 0a1d5984-449f-405b-b2de-49b97952b87c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a1d5984-449f-405b-b2de-49b97952b87c', 'volume_size': 1} Nov 03 08:25:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:19 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8cae2c35-70fc-4a6d-9a60-59bfd681865c tempest-VolumesExtendTest-1685417042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933.9fb9fcbd-5165-4e70-a618-e62a484301d8 1G" returned: 0 in 0.430s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8cae2c35-70fc-4a6d-9a60-59bfd681865c tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-288d58df-8df8-4473-a88e-d284e4cc9933 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933.9fb9fcbd-5165-4e70-a618-e62a484301d8 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:19 devstack sudo[99098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-288d58df-8df8-4473-a88e-d284e4cc9933 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933.9fb9fcbd-5165-4e70-a618-e62a484301d8 Nov 03 08:25:19 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:19 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8cae2c35-70fc-4a6d-9a60-59bfd681865c tempest-VolumesExtendTest-1685417042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-288d58df-8df8-4473-a88e-d284e4cc9933 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933.9fb9fcbd-5165-4e70-a618-e62a484301d8" returned: 0 in 0.286s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:19 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-8cae2c35-70fc-4a6d-9a60-59bfd681865c tempest-VolumesExtendTest-1685417042 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933.9fb9fcbd-5165-4e70-a618-e62a484301d8 is being set with open permissions: ugo+rw Nov 03 08:25:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8cae2c35-70fc-4a6d-9a60-59bfd681865c tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933.9fb9fcbd-5165-4e70-a618-e62a484301d8 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:19 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933.9fb9fcbd-5165-4e70-a618-e62a484301d8 Nov 03 08:25:19 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:19 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8cae2c35-70fc-4a6d-9a60-59bfd681865c tempest-VolumesExtendTest-1685417042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933.9fb9fcbd-5165-4e70-a618-e62a484301d8" returned: 0 in 0.240s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8cae2c35-70fc-4a6d-9a60-59bfd681865c tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:19 devstack sudo[99106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933.info Nov 03 08:25:19 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:19 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8cae2c35-70fc-4a6d-9a60-59bfd681865c tempest-VolumesExtendTest-1685417042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933.info" returned: 0 in 0.261s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:19 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-8cae2c35-70fc-4a6d-9a60-59bfd681865c tempest-VolumesExtendTest-1685417042 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933.info is being set with open permissions: ugo+rw Nov 03 08:25:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8cae2c35-70fc-4a6d-9a60-59bfd681865c tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:19 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933.info Nov 03 08:25:19 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:20 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8cae2c35-70fc-4a6d-9a60-59bfd681865c tempest-VolumesExtendTest-1685417042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933.info" returned: 0 in 0.242s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8cae2c35-70fc-4a6d-9a60-59bfd681865c tempest-VolumesExtendTest-1685417042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.956s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.146s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-538400812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a1d5984-449f-405b-b2de-49b97952b87c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08dfefd450414735b44210c1162a745d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:25:19Z,use_quota=True,user_id='c662ef8aa02e46099d577ed8a4195cfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:25:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Creating volume 0a1d5984-449f-405b-b2de-49b97952b87c {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:25:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:25:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:25:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:25:20 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:25:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0a1d5984-449f-405b-b2de-49b97952b87c 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:20 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0a1d5984-449f-405b-b2de-49b97952b87c 1073741824 Nov 03 08:25:20 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:20 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-8cae2c35-70fc-4a6d-9a60-59bfd681865c tempest-VolumesExtendTest-1685417042 None] Create snapshot completed successfully Nov 03 08:25:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3395dcdf-e963-4665-9856-d6f69210ca5d tempest-VolumesExtendTest-1685417042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:20 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0a1d5984-449f-405b-b2de-49b97952b87c 1073741824" returned: 0 in 0.479s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0a1d5984-449f-405b-b2de-49b97952b87c {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:20 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0a1d5984-449f-405b-b2de-49b97952b87c Nov 03 08:25:20 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:20 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0a1d5984-449f-405b-b2de-49b97952b87c" returned: 0 in 0.267s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:25:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3395dcdf-e963-4665-9856-d6f69210ca5d tempest-VolumesExtendTest-1685417042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.531s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ba5447-d3bb-4392-994f-2ff8fada3b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a1d5984-449f-405b-b2de-49b97952b87c', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e529712-1a20-4532-b450-fa735b54f785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:20 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[af923541-9aed-459a-937f-511c7e8f0bc4]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:25:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3395dcdf-e963-4665-9856-d6f69210ca5d tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:21 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Volume volume-0a1d5984-449f-405b-b2de-49b97952b87c (0a1d5984-449f-405b-b2de-49b97952b87c): created successfully Nov 03 08:25:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e529712-1a20-4532-b450-fa735b54f785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Flow 'volume_create_manager' (d4bce1c1-9104-461a-92b4-ab52b4521f78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:25:21 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-d4b114bb-2741-43ed-9a3e-01ac5ec157b1 tempest-VolumesTransfersTest-1164558466 None] Created volume successfully. Nov 03 08:25:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-fb368f3c-9995-432e-aa81-e5e7b1862961 req-f5f09286-157b-4538-8428-b45193216399 tempest-TestStampPattern-1669571982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:21 devstack sudo[99136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933 Nov 03 08:25:21 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:21 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3395dcdf-e963-4665-9856-d6f69210ca5d tempest-VolumesExtendTest-1685417042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933" returned: 0 in 0.373s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3395dcdf-e963-4665-9856-d6f69210ca5d tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933.9fb9fcbd-5165-4e70-a618-e62a484301d8 2G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3395dcdf-e963-4665-9856-d6f69210ca5d tempest-VolumesExtendTest-1685417042 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933.9fb9fcbd-5165-4e70-a618-e62a484301d8 2G" returned: 0 in 0.122s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3395dcdf-e963-4665-9856-d6f69210ca5d tempest-VolumesExtendTest-1685417042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.534s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-fb368f3c-9995-432e-aa81-e5e7b1862961 req-f5f09286-157b-4538-8428-b45193216399 tempest-TestStampPattern-1669571982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.395s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-fb368f3c-9995-432e-aa81-e5e7b1862961 req-f5f09286-157b-4538-8428-b45193216399 tempest-TestStampPattern-1669571982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:21 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-3395dcdf-e963-4665-9856-d6f69210ca5d tempest-VolumesExtendTest-1685417042 None] Extend volume completed successfully. Nov 03 08:25:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-fb368f3c-9995-432e-aa81-e5e7b1862961 req-f5f09286-157b-4538-8428-b45193216399 tempest-TestStampPattern-1669571982 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f', 'name': 'volume-662df0ef-8a4d-4103-a44e-200bd24397fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '63e65d12-3039-4743-8b78-0cf17d029921', 'enforce_multipath': True} {{(pid=86801) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 08:25:21 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-fb368f3c-9995-432e-aa81-e5e7b1862961 req-f5f09286-157b-4538-8428-b45193216399 tempest-TestStampPattern-1669571982 None] attachment_update completed successfully. Nov 03 08:25:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d18ae33b-a8f1-4a39-b3e8-ae7f43296b66 tempest-VolumesTransfersTest-1641114865 None] Acquiring lock "cinder-0a1d5984-449f-405b-b2de-49b97952b87c-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:25:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d18ae33b-a8f1-4a39-b3e8-ae7f43296b66 tempest-VolumesTransfersTest-1641114865 None] Lock "cinder-0a1d5984-449f-405b-b2de-49b97952b87c-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:25:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d18ae33b-a8f1-4a39-b3e8-ae7f43296b66 tempest-VolumesTransfersTest-1641114865 None] Acquiring lock "cinder-quobyte-0a1d5984-449f-405b-b2de-49b97952b87c" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:25:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d18ae33b-a8f1-4a39-b3e8-ae7f43296b66 tempest-VolumesTransfersTest-1641114865 None] Lock "cinder-quobyte-0a1d5984-449f-405b-b2de-49b97952b87c" acquired by "delete_volume" :: waited 0.014s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:25:22 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[f747b7d6-6d5b-499f-bd35-aeb35358646e]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:25:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d18ae33b-a8f1-4a39-b3e8-ae7f43296b66 tempest-VolumesTransfersTest-1641114865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0a1d5984-449f-405b-b2de-49b97952b87c {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:22 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0a1d5984-449f-405b-b2de-49b97952b87c Nov 03 08:25:22 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-98025cef-adfe-4d07-9985-8962715ec28a tempest-VolumesExtendTest-1685417042 None] Acquiring lock "cinder-9fb9fcbd-5165-4e70-a618-e62a484301d8-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:25:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-98025cef-adfe-4d07-9985-8962715ec28a tempest-VolumesExtendTest-1685417042 None] Lock "cinder-9fb9fcbd-5165-4e70-a618-e62a484301d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:25:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-98025cef-adfe-4d07-9985-8962715ec28a tempest-VolumesExtendTest-1685417042 None] Acquiring lock "cinder-quobyte-288d58df-8df8-4473-a88e-d284e4cc9933" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:25:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-98025cef-adfe-4d07-9985-8962715ec28a tempest-VolumesExtendTest-1685417042 None] Lock "cinder-quobyte-288d58df-8df8-4473-a88e-d284e4cc9933" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:25:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-98025cef-adfe-4d07-9985-8962715ec28a tempest-VolumesExtendTest-1685417042 None] Acquiring lock "cinder-quobyte-9fb9fcbd-5165-4e70-a618-e62a484301d8" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:25:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-98025cef-adfe-4d07-9985-8962715ec28a tempest-VolumesExtendTest-1685417042 None] Lock "cinder-quobyte-9fb9fcbd-5165-4e70-a618-e62a484301d8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:25:22 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-98025cef-adfe-4d07-9985-8962715ec28a tempest-VolumesExtendTest-1685417042 None] Deleting offline snapshot 9fb9fcbd-5165-4e70-a618-e62a484301d8 of volume 288d58df-8df8-4473-a88e-d284e4cc9933 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:25:22 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-98025cef-adfe-4d07-9985-8962715ec28a tempest-VolumesExtendTest-1685417042 None] snapshot_file for this snap is: volume-288d58df-8df8-4473-a88e-d284e4cc9933.9fb9fcbd-5165-4e70-a618-e62a484301d8 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:25:22 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[8350e59b-bca6-40fb-8bac-848162f5c7b6]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:25:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-98025cef-adfe-4d07-9985-8962715ec28a tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933.9fb9fcbd-5165-4e70-a618-e62a484301d8 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:22 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d18ae33b-a8f1-4a39-b3e8-ae7f43296b66 tempest-VolumesTransfersTest-1641114865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0a1d5984-449f-405b-b2de-49b97952b87c" returned: 0 in 0.369s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d18ae33b-a8f1-4a39-b3e8-ae7f43296b66 tempest-VolumesTransfersTest-1641114865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0a1d5984-449f-405b-b2de-49b97952b87c {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:22 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933.9fb9fcbd-5165-4e70-a618-e62a484301d8 Nov 03 08:25:22 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:22 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0a1d5984-449f-405b-b2de-49b97952b87c Nov 03 08:25:22 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:23 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d18ae33b-a8f1-4a39-b3e8-ae7f43296b66 tempest-VolumesTransfersTest-1641114865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0a1d5984-449f-405b-b2de-49b97952b87c" returned: 0 in 0.270s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:23 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d18ae33b-a8f1-4a39-b3e8-ae7f43296b66 tempest-VolumesTransfersTest-1641114865 None] Lock "cinder-quobyte-0a1d5984-449f-405b-b2de-49b97952b87c" released by "delete_volume" :: held 0.688s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:25:23 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-98025cef-adfe-4d07-9985-8962715ec28a tempest-VolumesExtendTest-1685417042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933.9fb9fcbd-5165-4e70-a618-e62a484301d8" returned: 0 in 0.398s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-98025cef-adfe-4d07-9985-8962715ec28a tempest-VolumesExtendTest-1685417042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-288d58df-8df8-4473-a88e-d284e4cc9933(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:25:23 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[569e1e43-4e6d-402a-b372-5db99057e403]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:25:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-98025cef-adfe-4d07-9985-8962715ec28a tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:23 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-d18ae33b-a8f1-4a39-b3e8-ae7f43296b66 tempest-VolumesTransfersTest-1641114865 None] Created reservations ['ea573d20-fd17-4ac8-ba3f-2a04ad78faa5', 'da6bf2d0-9023-4feb-9b9e-e77abce2589a', 'e81486df-6409-4a88-b96c-8050a58a52c8', '01c59391-2fd2-4ba9-ae03-824d9c53ded0'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:25:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d18ae33b-a8f1-4a39-b3e8-ae7f43296b66 tempest-VolumesTransfersTest-1641114865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d18ae33b-a8f1-4a39-b3e8-ae7f43296b66 tempest-VolumesTransfersTest-1641114865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d18ae33b-a8f1-4a39-b3e8-ae7f43296b66 tempest-VolumesTransfersTest-1641114865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:25:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d18ae33b-a8f1-4a39-b3e8-ae7f43296b66 tempest-VolumesTransfersTest-1641114865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:25:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d18ae33b-a8f1-4a39-b3e8-ae7f43296b66 tempest-VolumesTransfersTest-1641114865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d18ae33b-a8f1-4a39-b3e8-ae7f43296b66 tempest-VolumesTransfersTest-1641114865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:23 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933 Nov 03 08:25:23 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:23 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:25:23 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:23 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:23 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d18ae33b-a8f1-4a39-b3e8-ae7f43296b66 tempest-VolumesTransfersTest-1641114865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.305s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:23 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-d18ae33b-a8f1-4a39-b3e8-ae7f43296b66 tempest-VolumesTransfersTest-1641114865 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:25:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-98025cef-adfe-4d07-9985-8962715ec28a tempest-VolumesExtendTest-1685417042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933" returned: 0 in 0.423s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-98025cef-adfe-4d07-9985-8962715ec28a tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933.9fb9fcbd-5165-4e70-a618-e62a484301d8 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:23 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-d18ae33b-a8f1-4a39-b3e8-ae7f43296b66 tempest-VolumesTransfersTest-1641114865 None] Deleted volume successfully. Nov 03 08:25:23 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933.9fb9fcbd-5165-4e70-a618-e62a484301d8 Nov 03 08:25:23 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:23 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d18ae33b-a8f1-4a39-b3e8-ae7f43296b66 tempest-VolumesTransfersTest-1641114865 None] Lock "cinder-0a1d5984-449f-405b-b2de-49b97952b87c-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:25:24 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-98025cef-adfe-4d07-9985-8962715ec28a tempest-VolumesExtendTest-1685417042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933.9fb9fcbd-5165-4e70-a618-e62a484301d8" returned: 0 in 0.427s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-98025cef-adfe-4d07-9985-8962715ec28a tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933.9fb9fcbd-5165-4e70-a618-e62a484301d8 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:24 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933.9fb9fcbd-5165-4e70-a618-e62a484301d8 Nov 03 08:25:24 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:24 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-98025cef-adfe-4d07-9985-8962715ec28a tempest-VolumesExtendTest-1685417042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933.9fb9fcbd-5165-4e70-a618-e62a484301d8" returned: 0 in 0.270s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:24 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-98025cef-adfe-4d07-9985-8962715ec28a tempest-VolumesExtendTest-1685417042 None] Lock "cinder-quobyte-9fb9fcbd-5165-4e70-a618-e62a484301d8" released by "_delete_snapshot" :: held 1.643s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:25:24 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-98025cef-adfe-4d07-9985-8962715ec28a tempest-VolumesExtendTest-1685417042 None] Lock "cinder-quobyte-288d58df-8df8-4473-a88e-d284e4cc9933" released by "delete_snapshot" :: held 1.665s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:25:24 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-98025cef-adfe-4d07-9985-8962715ec28a tempest-VolumesExtendTest-1685417042 None] Created reservations ['52b6649f-6f4e-41df-b8f3-6678b7711244', '77044c70-09a6-452c-94f7-051c86d93020', 'c19a9a3d-fe68-4526-8466-0f5cce8321f1', '03f6e409-101b-4ff2-8a25-03a0d2310e3e'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:25:24 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-98025cef-adfe-4d07-9985-8962715ec28a tempest-VolumesExtendTest-1685417042 None] Delete snapshot completed successfully. Nov 03 08:25:24 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-98025cef-adfe-4d07-9985-8962715ec28a tempest-VolumesExtendTest-1685417042 None] Lock "cinder-9fb9fcbd-5165-4e70-a618-e62a484301d8-delete_snapshot" released by "delete_snapshot" :: held 1.825s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:25:24 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-acc9cb0e-bf00-4d54-916e-360fa44f854f tempest-VolumesExtendTest-1685417042 None] Acquiring lock "cinder-288d58df-8df8-4473-a88e-d284e4cc9933-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:25:24 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-acc9cb0e-bf00-4d54-916e-360fa44f854f tempest-VolumesExtendTest-1685417042 None] Lock "cinder-288d58df-8df8-4473-a88e-d284e4cc9933-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:25:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-acc9cb0e-bf00-4d54-916e-360fa44f854f tempest-VolumesExtendTest-1685417042 None] Acquiring lock "cinder-quobyte-288d58df-8df8-4473-a88e-d284e4cc9933" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:25:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-acc9cb0e-bf00-4d54-916e-360fa44f854f tempest-VolumesExtendTest-1685417042 None] Lock "cinder-quobyte-288d58df-8df8-4473-a88e-d284e4cc9933" acquired by "delete_volume" :: waited 0.024s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:25:25 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8c4a9d-7a02-41b7-961c-991af5cc4418]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:25:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-acc9cb0e-bf00-4d54-916e-360fa44f854f tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:25 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933 Nov 03 08:25:25 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:25 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-acc9cb0e-bf00-4d54-916e-360fa44f854f tempest-VolumesExtendTest-1685417042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933" returned: 0 in 0.442s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-acc9cb0e-bf00-4d54-916e-360fa44f854f tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:25 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933 Nov 03 08:25:25 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:25 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-acc9cb0e-bf00-4d54-916e-360fa44f854f tempest-VolumesExtendTest-1685417042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-288d58df-8df8-4473-a88e-d284e4cc9933" returned: 0 in 0.282s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-acc9cb0e-bf00-4d54-916e-360fa44f854f tempest-VolumesExtendTest-1685417042 None] Lock "cinder-quobyte-288d58df-8df8-4473-a88e-d284e4cc9933" released by "delete_volume" :: held 0.818s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:25:25 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-acc9cb0e-bf00-4d54-916e-360fa44f854f tempest-VolumesExtendTest-1685417042 None] Created reservations ['1bd7c569-eb55-4fe3-be62-8f8103db6cfd', 'f928eaea-8479-4635-acc4-d33a743b3411', '60eb58d8-5212-4289-93f3-92b3c27c0561', '68cc775f-9561-4520-8f8d-16e83765d168'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:25:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-acc9cb0e-bf00-4d54-916e-360fa44f854f tempest-VolumesExtendTest-1685417042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-acc9cb0e-bf00-4d54-916e-360fa44f854f tempest-VolumesExtendTest-1685417042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:26 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-acc9cb0e-bf00-4d54-916e-360fa44f854f tempest-VolumesExtendTest-1685417042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:25:26 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-acc9cb0e-bf00-4d54-916e-360fa44f854f tempest-VolumesExtendTest-1685417042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:25:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-acc9cb0e-bf00-4d54-916e-360fa44f854f tempest-VolumesExtendTest-1685417042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-acc9cb0e-bf00-4d54-916e-360fa44f854f tempest-VolumesExtendTest-1685417042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:26 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:25:26 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:26 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-acc9cb0e-bf00-4d54-916e-360fa44f854f tempest-VolumesExtendTest-1685417042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.352s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:26 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-acc9cb0e-bf00-4d54-916e-360fa44f854f tempest-VolumesExtendTest-1685417042 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:25:26 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-acc9cb0e-bf00-4d54-916e-360fa44f854f tempest-VolumesExtendTest-1685417042 None] Deleted volume successfully. Nov 03 08:25:26 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-acc9cb0e-bf00-4d54-916e-360fa44f854f tempest-VolumesExtendTest-1685417042 None] Lock "cinder-288d58df-8df8-4473-a88e-d284e4cc9933-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:25:27 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=89,cinder:UPDATE=132,cinder:DELETE=11,cinder:INSERT=34 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:25:27 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:UPDATE=119,cinder:INSERT=34,cinder:SELECT=108,cinder:DELETE=10 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:25:27 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-ae8cc279-3c82-4a66-89ce-8c7906da4f0a req-7263aa18-d319-4e3a-9d96-97445ad72031 tempest-TestStampPattern-1669571982 None] Terminate volume connection completed successfully. Nov 03 08:25:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-ae8cc279-3c82-4a66-89ce-8c7906da4f0a req-7263aa18-d319-4e3a-9d96-97445ad72031 tempest-TestStampPattern-1669571982 None] Deleting attachment 63e65d12-3039-4743-8b78-0cf17d029921. {{(pid=86801) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 08:25:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-67951d48-fee7-4bb5-998d-0e9df4f556cc tempest-TestStampPattern-1669571982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-67951d48-fee7-4bb5-998d-0e9df4f556cc tempest-TestStampPattern-1669571982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-67951d48-fee7-4bb5-998d-0e9df4f556cc tempest-TestStampPattern-1669571982 None] Creating offline snapshot 9262172a-ec05-4227-8bb1-00156835f016 of volume 662df0ef-8a4d-4103-a44e-200bd24397fb {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:25:27 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[672d7d23-aba8-4ea2-ba66-775ecafa0bd9]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:25:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-67951d48-fee7-4bb5-998d-0e9df4f556cc tempest-TestStampPattern-1669571982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:28 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb Nov 03 08:25:28 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:28 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-67951d48-fee7-4bb5-998d-0e9df4f556cc tempest-TestStampPattern-1669571982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb" returned: 0 in 0.448s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-67951d48-fee7-4bb5-998d-0e9df4f556cc tempest-TestStampPattern-1669571982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.9262172a-ec05-4227-8bb1-00156835f016 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:28 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.9262172a-ec05-4227-8bb1-00156835f016 1G Nov 03 08:25:28 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:28 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-67951d48-fee7-4bb5-998d-0e9df4f556cc tempest-TestStampPattern-1669571982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.9262172a-ec05-4227-8bb1-00156835f016 1G" returned: 0 in 0.492s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-67951d48-fee7-4bb5-998d-0e9df4f556cc tempest-TestStampPattern-1669571982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-662df0ef-8a4d-4103-a44e-200bd24397fb -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.9262172a-ec05-4227-8bb1-00156835f016 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:28 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-662df0ef-8a4d-4103-a44e-200bd24397fb -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.9262172a-ec05-4227-8bb1-00156835f016 Nov 03 08:25:28 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:29 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-67951d48-fee7-4bb5-998d-0e9df4f556cc tempest-TestStampPattern-1669571982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-662df0ef-8a4d-4103-a44e-200bd24397fb -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.9262172a-ec05-4227-8bb1-00156835f016" returned: 0 in 0.361s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:29 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-67951d48-fee7-4bb5-998d-0e9df4f556cc tempest-TestStampPattern-1669571982 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.9262172a-ec05-4227-8bb1-00156835f016 is being set with open permissions: ugo+rw Nov 03 08:25:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-67951d48-fee7-4bb5-998d-0e9df4f556cc tempest-TestStampPattern-1669571982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.9262172a-ec05-4227-8bb1-00156835f016 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:29 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.9262172a-ec05-4227-8bb1-00156835f016 Nov 03 08:25:29 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:29 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-67951d48-fee7-4bb5-998d-0e9df4f556cc tempest-TestStampPattern-1669571982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.9262172a-ec05-4227-8bb1-00156835f016" returned: 0 in 0.268s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-67951d48-fee7-4bb5-998d-0e9df4f556cc tempest-TestStampPattern-1669571982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:29 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.info Nov 03 08:25:29 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:29 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-67951d48-fee7-4bb5-998d-0e9df4f556cc tempest-TestStampPattern-1669571982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.info" returned: 0 in 0.288s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:29 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-67951d48-fee7-4bb5-998d-0e9df4f556cc tempest-TestStampPattern-1669571982 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.info is being set with open permissions: ugo+rw Nov 03 08:25:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-67951d48-fee7-4bb5-998d-0e9df4f556cc tempest-TestStampPattern-1669571982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:29 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.info Nov 03 08:25:29 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:30 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-67951d48-fee7-4bb5-998d-0e9df4f556cc tempest-TestStampPattern-1669571982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.info" returned: 0 in 0.285s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-67951d48-fee7-4bb5-998d-0e9df4f556cc tempest-TestStampPattern-1669571982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.266s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:30 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-67951d48-fee7-4bb5-998d-0e9df4f556cc tempest-TestStampPattern-1669571982 None] Create snapshot completed successfully Nov 03 08:25:30 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:25:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Flow 'volume_create_manager' (954f6be2-7d36-449b-a310-ee5075b8ee5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:25:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed092c0-2086-4618-a856-fc8d2ffb5742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed092c0-2086-4618-a856-fc8d2ffb5742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1842029911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476187a30d30478ab7c74597d5d81913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:25:31Z,use_quota=True,user_id='c08b9d2f92c24de6906272de7a7521ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0734c6bb-1303-489b-805a-292456f0eda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0734c6bb-1303-489b-805a-292456f0eda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea00ef7b-851c-4321-a3b1-facca5b66551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea00ef7b-851c-4321-a3b1-facca5b66551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae', 'volume_name': 'volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d863c7dc-1748-4eb9-accd-db18e3ea903e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d863c7dc-1748-4eb9-accd-db18e3ea903e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2412c7b-9a6b-4329-a91f-3b5804e6da83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:30 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Volume 66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae', 'volume_size': 1} Nov 03 08:25:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1842029911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476187a30d30478ab7c74597d5d81913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:25:31Z,use_quota=True,user_id='c08b9d2f92c24de6906272de7a7521ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:25:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Creating volume 66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:25:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:25:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:25:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:25:30 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:25:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:30 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae 1073741824 Nov 03 08:25:30 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Flow 'volume_create_manager' (fdab2d9d-c2af-44b4-8bc6-62bd0a384afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12abbee-d796-4bd6-ab5f-d27df48f83a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12abbee-d796-4bd6-ab5f-d27df48f83a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1684427391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f99dda5f-f973-4a32-a59c-568a256239e4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8bcb0ca2055443f1817921e81f500de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:25:31Z,use_quota=True,user_id='2ba8718f77974c5aad5aa832a07e697b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941d0f98-ff0d-4cba-aed4-af487952700f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941d0f98-ff0d-4cba-aed4-af487952700f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a83223a2-dfd2-4f17-8299-991f6cd9b28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a83223a2-dfd2-4f17-8299-991f6cd9b28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f99dda5f-f973-4a32-a59c-568a256239e4', 'volume_name': 'volume-f99dda5f-f973-4a32-a59c-568a256239e4', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1652826f-3b22-45cd-9851-095070156f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1652826f-3b22-45cd-9851-095070156f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbb2c7db-8aaf-43ac-8404-fc27b1e68657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:31 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Volume f99dda5f-f973-4a32-a59c-568a256239e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f99dda5f-f973-4a32-a59c-568a256239e4', 'volume_size': 1} Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:31 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae 1073741824" returned: 0 in 0.498s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:31 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae Nov 03 08:25:31 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:31 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae" returned: 0 in 0.249s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.358s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1684427391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f99dda5f-f973-4a32-a59c-568a256239e4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8bcb0ca2055443f1817921e81f500de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:25:31Z,use_quota=True,user_id='2ba8718f77974c5aad5aa832a07e697b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Creating volume f99dda5f-f973-4a32-a59c-568a256239e4 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:25:31 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f99dda5f-f973-4a32-a59c-568a256239e4 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2412c7b-9a6b-4329-a91f-3b5804e6da83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:31 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f99dda5f-f973-4a32-a59c-568a256239e4 1073741824 Nov 03 08:25:31 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a97d75b-608d-4207-a886-901889af4088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:31 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Volume volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae (66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae): created successfully Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a97d75b-608d-4207-a886-901889af4088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Flow 'volume_create_manager' (954f6be2-7d36-449b-a310-ee5075b8ee5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:25:31 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-50a3d8a7-10b6-4d73-9fde-91f0b8b168b2 tempest-VolumesCloneTest-1466405401 None] Created volume successfully. Nov 03 08:25:31 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f99dda5f-f973-4a32-a59c-568a256239e4 1073741824" returned: 0 in 0.483s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f99dda5f-f973-4a32-a59c-568a256239e4 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:32 devstack sudo[99692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f99dda5f-f973-4a32-a59c-568a256239e4 Nov 03 08:25:32 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:32 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f99dda5f-f973-4a32-a59c-568a256239e4" returned: 0 in 0.276s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:32 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:25:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbb2c7db-8aaf-43ac-8404-fc27b1e68657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f99dda5f-f973-4a32-a59c-568a256239e4', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e457ce6-08c8-4870-bf7f-90f6512a3117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:32 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Volume volume-f99dda5f-f973-4a32-a59c-568a256239e4 (f99dda5f-f973-4a32-a59c-568a256239e4): created successfully Nov 03 08:25:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e457ce6-08c8-4870-bf7f-90f6512a3117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Flow 'volume_create_manager' (fdab2d9d-c2af-44b4-8bc6-62bd0a384afd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:25:32 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-df82f21d-8102-4c5a-8ecd-30fdf78b3b12 tempest-VolumesGetTest-1275841772 None] Created volume successfully. Nov 03 08:25:33 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:25:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Flow 'volume_create_manager' (6daa6512-b44a-4f00-9817-a353927ee5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:25:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3990be2-dbb0-4f28-b786-ddd776bbc2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3990be2-dbb0-4f28-b786-ddd776bbc2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1728781484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c7c4d34-d858-40cc-85e7-d316a5442022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476187a30d30478ab7c74597d5d81913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:25:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae,status='creating',terminated_at=None,updated_at=2026-11-03T07:25:33Z,use_quota=True,user_id='c08b9d2f92c24de6906272de7a7521ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f695743d-fd99-4009-b5cd-d2128f84b6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f695743d-fd99-4009-b5cd-d2128f84b6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d0db31-bc06-4403-9e03-dcde89b0d8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d0db31-bc06-4403-9e03-dcde89b0d8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9c7c4d34-d858-40cc-85e7-d316a5442022', 'volume_name': 'volume-9c7c4d34-d858-40cc-85e7-d316a5442022', 'volume_size': 2, 'source_volid': '66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae', 'source_volstatus': 'available'}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc93337-c222-42ab-9cc1-f55b61c61812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc93337-c222-42ab-9cc1-f55b61c61812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7f0025-3cbe-4c67-af8a-c98714ec798b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:33 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Volume 9c7c4d34-d858-40cc-85e7-d316a5442022: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9c7c4d34-d858-40cc-85e7-d316a5442022', 'volume_size': 2, 'source_volid': '66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae', 'source_volstatus': 'available'} Nov 03 08:25:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:33 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Cloning volume 66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae to volume 9c7c4d34-d858-40cc-85e7-d316a5442022 Nov 03 08:25:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Creating offline snapshot 11a00227-66b3-4480-a510-c44aa16a2dbf of volume 66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:25:33 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48f2f8d-15a8-4c29-bca1-93b1344f0758]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:25:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:33 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae Nov 03 08:25:33 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:33 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae" returned: 0 in 0.466s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.11a00227-66b3-4480-a510-c44aa16a2dbf 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:33 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.11a00227-66b3-4480-a510-c44aa16a2dbf 1G Nov 03 08:25:33 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:34 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:25:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Flow 'volume_create_manager' (63275c6b-14d2-4e5c-9060-b4f7f460f776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:25:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671e5ce9-0beb-4f4a-9dd3-8349a6fc819d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671e5ce9-0beb-4f4a-9dd3-8349a6fc819d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:25:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1095688915',display_name='tempest-VolumesGetTest-Volume-1350877232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=011daa6b-94e8-48ec-8cd9-079c7ec43cee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bcb0ca2055443f1817921e81f500de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:25:34Z,use_quota=True,user_id='2ba8718f77974c5aad5aa832a07e697b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11c2f64-ce8e-48e5-b5b8-56d7e3af4d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11c2f64-ce8e-48e5-b5b8-56d7e3af4d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf7e765b-3a20-4c3f-82a2-d5c17c24e0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf7e765b-3a20-4c3f-82a2-d5c17c24e0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '011daa6b-94e8-48ec-8cd9-079c7ec43cee', 'volume_name': 'volume-011daa6b-94e8-48ec-8cd9-079c7ec43cee', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42205b8d-4500-4e36-a460-db9da854fe30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42205b8d-4500-4e36-a460-db9da854fe30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da9f0e35-b538-422c-91e2-29eb77a8f80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:34 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Volume 011daa6b-94e8-48ec-8cd9-079c7ec43cee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-011daa6b-94e8-48ec-8cd9-079c7ec43cee', 'volume_size': 1} Nov 03 08:25:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:34 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.11a00227-66b3-4480-a510-c44aa16a2dbf 1G" returned: 0 in 0.479s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.11a00227-66b3-4480-a510-c44aa16a2dbf {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:34 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.11a00227-66b3-4480-a510-c44aa16a2dbf Nov 03 08:25:34 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:34 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.11a00227-66b3-4480-a510-c44aa16a2dbf" returned: 0 in 0.310s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:34 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.11a00227-66b3-4480-a510-c44aa16a2dbf is being set with open permissions: ugo+rw Nov 03 08:25:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.11a00227-66b3-4480-a510-c44aa16a2dbf {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:34 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.11a00227-66b3-4480-a510-c44aa16a2dbf Nov 03 08:25:34 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:34 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.11a00227-66b3-4480-a510-c44aa16a2dbf" returned: 0 in 0.255s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:35 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.info Nov 03 08:25:35 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:35 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.info" returned: 0 in 0.275s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:35 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.info is being set with open permissions: ugo+rw Nov 03 08:25:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:35 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.info Nov 03 08:25:35 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:35 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.info" returned: 0 in 0.246s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Acquiring lock "cinder-quobyte-9c7c4d34-d858-40cc-85e7-d316a5442022" by "_copy_volume_from_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:25:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Lock "cinder-quobyte-9c7c4d34-d858-40cc-85e7-d316a5442022" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:25:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] snapshot: 11a00227-66b3-4480-a510-c44aa16a2dbf, volume: 9c7c4d34-d858-40cc-85e7-d316a5442022, {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 08:25:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:25:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:25:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:35 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa6204a-153a-41f7-8400-3f8689fab257]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:25:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.11a00227-66b3-4480-a510-c44aa16a2dbf {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:35 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.11a00227-66b3-4480-a510-c44aa16a2dbf Nov 03 08:25:35 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:36 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.11a00227-66b3-4480-a510-c44aa16a2dbf" returned: 0 in 0.395s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:25:36 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[57224347-3278-4946-b5d6-db1269f3cde3]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:25:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:36 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae Nov 03 08:25:36 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:36 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae" returned: 0 in 0.398s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 08:25:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Creating direct copy from snapshot {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 08:25:36 devstack cinder-volume[86801]: DEBUG cinder.utils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Path /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9c7c4d34-d858-40cc-85e7-d316a5442022 not found in is_blk_device check {{(pid=86801) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 08:25:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9c7c4d34-d858-40cc-85e7-d316a5442022 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:36 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9c7c4d34-d858-40cc-85e7-d316a5442022 Nov 03 08:25:36 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:38 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:25:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Flow 'volume_create_manager' (a86f8ca5-0ac6-428e-9150-bf133fa97c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:25:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f94b4d61-2d8a-43e6-ad4c-49e16dc9a645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f94b4d61-2d8a-43e6-ad4c-49e16dc9a645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1432346219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28c3563b-0f7d-4042-b6d4-f2c93e328dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fb45dba92b4e72b7f1f98c37c329af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9262172a-ec05-4227-8bb1-00156835f016,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:25:38Z,use_quota=True,user_id='dddeb7b6abb04c1f8b09d5fa060b214f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b437429b-c120-48bc-9316-709a988b2d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b437429b-c120-48bc-9316-709a988b2d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3934ac0b-636a-478b-bcc3-de5a50f3f309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3934ac0b-636a-478b-bcc3-de5a50f3f309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '28c3563b-0f7d-4042-b6d4-f2c93e328dcb', 'volume_name': 'volume-28c3563b-0f7d-4042-b6d4-f2c93e328dcb', 'volume_size': 1, 'snapshot_id': '9262172a-ec05-4227-8bb1-00156835f016'}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d8b0ea-8ab4-43c2-85c5-2dd7a70e78f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d8b0ea-8ab4-43c2-85c5-2dd7a70e78f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6faa15c5-21f1-4165-99d7-697ecddc1234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:38 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Volume 28c3563b-0f7d-4042-b6d4-f2c93e328dcb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-28c3563b-0f7d-4042-b6d4-f2c93e328dcb', 'volume_size': 1, 'snapshot_id': '9262172a-ec05-4227-8bb1-00156835f016'} Nov 03 08:25:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:44 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9c7c4d34-d858-40cc-85e7-d316a5442022" returned: 0 in 7.943s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:44 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae, size 1024.00 MB, duration 7.94 sec, destination /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9c7c4d34-d858-40cc-85e7-d316a5442022 {{(pid=86801) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 08:25:44 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Converted 1024.00 MB image at 128.90 MB/s Nov 03 08:25:44 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9c7c4d34-d858-40cc-85e7-d316a5442022 is being set with open permissions: ugo+rw Nov 03 08:25:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9c7c4d34-d858-40cc-85e7-d316a5442022 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:44 devstack sudo[99775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9c7c4d34-d858-40cc-85e7-d316a5442022 Nov 03 08:25:44 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:44 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9c7c4d34-d858-40cc-85e7-d316a5442022" returned: 0 in 0.255s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Lock "cinder-quobyte-9c7c4d34-d858-40cc-85e7-d316a5442022" released by "_copy_volume_from_snapshot" :: held 9.070s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:25:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Acquiring lock "cinder-quobyte-11a00227-66b3-4480-a510-c44aa16a2dbf" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:25:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Lock "cinder-quobyte-11a00227-66b3-4480-a510-c44aa16a2dbf" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:25:44 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Deleting offline snapshot 11a00227-66b3-4480-a510-c44aa16a2dbf of volume 66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:25:44 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] snapshot_file for this snap is: volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.11a00227-66b3-4480-a510-c44aa16a2dbf {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:25:44 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c4d60f-ba39-4f07-bde4-089dbcfa623d]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:25:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.11a00227-66b3-4480-a510-c44aa16a2dbf {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:44 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.11a00227-66b3-4480-a510-c44aa16a2dbf Nov 03 08:25:44 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:45 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.11a00227-66b3-4480-a510-c44aa16a2dbf" returned: 0 in 0.514s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:45 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:25:45 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcef34d2-a373-4e79-84a9-43e1a3a6cd2f]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:25:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:45 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae Nov 03 08:25:45 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:46 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae" returned: 0 in 0.722s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.11a00227-66b3-4480-a510-c44aa16a2dbf {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:46 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.11a00227-66b3-4480-a510-c44aa16a2dbf Nov 03 08:25:46 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:46 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.11a00227-66b3-4480-a510-c44aa16a2dbf" returned: 0 in 0.533s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.11a00227-66b3-4480-a510-c44aa16a2dbf {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:46 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.11a00227-66b3-4480-a510-c44aa16a2dbf Nov 03 08:25:46 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:46 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae.11a00227-66b3-4480-a510-c44aa16a2dbf" returned: 0 in 0.304s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:46 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Lock "cinder-quobyte-11a00227-66b3-4480-a510-c44aa16a2dbf" released by "_delete_snapshot" :: held 2.198s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:25:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.551s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.839s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:25:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1095688915',display_name='tempest-VolumesGetTest-Volume-1350877232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=011daa6b-94e8-48ec-8cd9-079c7ec43cee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bcb0ca2055443f1817921e81f500de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:25:34Z,use_quota=True,user_id='2ba8718f77974c5aad5aa832a07e697b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:25:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Creating volume 011daa6b-94e8-48ec-8cd9-079c7ec43cee {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:25:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:25:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:25:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:25:46 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:25:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-011daa6b-94e8-48ec-8cd9-079c7ec43cee 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:47 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-011daa6b-94e8-48ec-8cd9-079c7ec43cee 1073741824 Nov 03 08:25:47 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7f0025-3cbe-4c67-af8a-c98714ec798b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c7c4d34-d858-40cc-85e7-d316a5442022', 'volume_size': 2, 'source_volid': '66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae', 'source_volstatus': 'available'}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a001eb70-4c4b-40c4-b7bd-8ae102be1908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:47 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Volume volume-9c7c4d34-d858-40cc-85e7-d316a5442022 (9c7c4d34-d858-40cc-85e7-d316a5442022): created successfully Nov 03 08:25:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a001eb70-4c4b-40c4-b7bd-8ae102be1908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Flow 'volume_create_manager' (6daa6512-b44a-4f00-9817-a353927ee5dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:25:47 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-5b361e2e-e961-4bd3-9dfd-f0504301a597 tempest-VolumesCloneTest-1466405401 None] Created volume successfully. Nov 03 08:25:47 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-011daa6b-94e8-48ec-8cd9-079c7ec43cee 1073741824" returned: 0 in 0.570s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-011daa6b-94e8-48ec-8cd9-079c7ec43cee {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:47 devstack sudo[99876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-011daa6b-94e8-48ec-8cd9-079c7ec43cee Nov 03 08:25:47 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-86919216-d359-4e38-bf49-2abbc9beffa8 tempest-VolumesCloneTest-1466405401 None] Acquiring lock "cinder-9c7c4d34-d858-40cc-85e7-d316a5442022-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:25:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-86919216-d359-4e38-bf49-2abbc9beffa8 tempest-VolumesCloneTest-1466405401 None] Lock "cinder-9c7c4d34-d858-40cc-85e7-d316a5442022-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:25:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-86919216-d359-4e38-bf49-2abbc9beffa8 tempest-VolumesCloneTest-1466405401 None] Acquiring lock "cinder-quobyte-9c7c4d34-d858-40cc-85e7-d316a5442022" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:25:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-86919216-d359-4e38-bf49-2abbc9beffa8 tempest-VolumesCloneTest-1466405401 None] Lock "cinder-quobyte-9c7c4d34-d858-40cc-85e7-d316a5442022" acquired by "delete_volume" :: waited 0.025s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:25:47 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[79164632-a326-46b8-bc33-6ccd906f328a]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:25:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-86919216-d359-4e38-bf49-2abbc9beffa8 tempest-VolumesCloneTest-1466405401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9c7c4d34-d858-40cc-85e7-d316a5442022 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:48 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-011daa6b-94e8-48ec-8cd9-079c7ec43cee" returned: 0 in 0.416s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 9.399s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Acquiring lock "cinder-quobyte-9262172a-ec05-4227-8bb1-00156835f016-28c3563b-0f7d-4042-b6d4-f2c93e328dcb" by "_create_volume_from_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da9f0e35-b538-422c-91e2-29eb77a8f80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-011daa6b-94e8-48ec-8cd9-079c7ec43cee', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121ca140-52a0-429e-99ae-3a58705ea6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Lock "cinder-quobyte-9262172a-ec05-4227-8bb1-00156835f016-28c3563b-0f7d-4042-b6d4-f2c93e328dcb" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Creating volume 28c3563b-0f7d-4042-b6d4-f2c93e328dcb from snapshot 9262172a-ec05-4227-8bb1-00156835f016 {{(pid=86801) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Acquiring lock "cinder-quobyte-28c3563b-0f7d-4042-b6d4-f2c93e328dcb" by "_copy_volume_from_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:25:48 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9c7c4d34-d858-40cc-85e7-d316a5442022 Nov 03 08:25:48 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:48 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Volume volume-011daa6b-94e8-48ec-8cd9-079c7ec43cee (011daa6b-94e8-48ec-8cd9-079c7ec43cee): created successfully Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121ca140-52a0-429e-99ae-3a58705ea6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Flow 'volume_create_manager' (63275c6b-14d2-4e5c-9060-b4f7f460f776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Lock "cinder-quobyte-28c3563b-0f7d-4042-b6d4-f2c93e328dcb" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] snapshot: 9262172a-ec05-4227-8bb1-00156835f016, volume: 28c3563b-0f7d-4042-b6d4-f2c93e328dcb, {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 08:25:48 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-86353593-99c5-452f-a1bf-a7789e9891bf tempest-VolumesGetTest-1275841772 None] Created volume successfully. Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a307ae-a98f-431c-8807-11bd16739161]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.9262172a-ec05-4227-8bb1-00156835f016 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:48 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.9262172a-ec05-4227-8bb1-00156835f016 Nov 03 08:25:48 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:48 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-86919216-d359-4e38-bf49-2abbc9beffa8 tempest-VolumesCloneTest-1466405401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9c7c4d34-d858-40cc-85e7-d316a5442022" returned: 0 in 0.541s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-86919216-d359-4e38-bf49-2abbc9beffa8 tempest-VolumesCloneTest-1466405401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9c7c4d34-d858-40cc-85e7-d316a5442022 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:48 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9c7c4d34-d858-40cc-85e7-d316a5442022 Nov 03 08:25:48 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4e6167ed-912f-4ead-9f0a-820bd6e21b34 tempest-VolumesGetTest-1275841772 None] Acquiring lock "cinder-011daa6b-94e8-48ec-8cd9-079c7ec43cee-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4e6167ed-912f-4ead-9f0a-820bd6e21b34 tempest-VolumesGetTest-1275841772 None] Lock "cinder-011daa6b-94e8-48ec-8cd9-079c7ec43cee-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4e6167ed-912f-4ead-9f0a-820bd6e21b34 tempest-VolumesGetTest-1275841772 None] Acquiring lock "cinder-quobyte-011daa6b-94e8-48ec-8cd9-079c7ec43cee" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4e6167ed-912f-4ead-9f0a-820bd6e21b34 tempest-VolumesGetTest-1275841772 None] Lock "cinder-quobyte-011daa6b-94e8-48ec-8cd9-079c7ec43cee" acquired by "delete_volume" :: waited 0.030s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff543489-ba1a-4765-a5f4-3b142e552713]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4e6167ed-912f-4ead-9f0a-820bd6e21b34 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-011daa6b-94e8-48ec-8cd9-079c7ec43cee {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:48 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.9262172a-ec05-4227-8bb1-00156835f016" returned: 0 in 0.684s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-662df0ef-8a4d-4103-a44e-200bd24397fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:25:48 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-86919216-d359-4e38-bf49-2abbc9beffa8 tempest-VolumesCloneTest-1466405401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9c7c4d34-d858-40cc-85e7-d316a5442022" returned: 0 in 0.433s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7701a9-df19-442f-9174-532866b9de6c]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:48 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-86919216-d359-4e38-bf49-2abbc9beffa8 tempest-VolumesCloneTest-1466405401 None] Lock "cinder-quobyte-9c7c4d34-d858-40cc-85e7-d316a5442022" released by "delete_volume" :: held 1.045s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:25:48 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-011daa6b-94e8-48ec-8cd9-079c7ec43cee Nov 03 08:25:48 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:49 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-86919216-d359-4e38-bf49-2abbc9beffa8 tempest-VolumesCloneTest-1466405401 None] Created reservations ['6684cd15-bff8-494e-a6c6-e7074a8dbb5d', 'b1e29032-e560-4f07-92dc-261d82b838e2', '74da4787-9917-4a64-b2fa-e9053285c969', '392955fc-7a8a-4d42-8dd4-7fd12389aaab'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:25:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-86919216-d359-4e38-bf49-2abbc9beffa8 tempest-VolumesCloneTest-1466405401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-86919216-d359-4e38-bf49-2abbc9beffa8 tempest-VolumesCloneTest-1466405401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:49 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-86919216-d359-4e38-bf49-2abbc9beffa8 tempest-VolumesCloneTest-1466405401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:25:49 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-86919216-d359-4e38-bf49-2abbc9beffa8 tempest-VolumesCloneTest-1466405401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:25:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-86919216-d359-4e38-bf49-2abbc9beffa8 tempest-VolumesCloneTest-1466405401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-86919216-d359-4e38-bf49-2abbc9beffa8 tempest-VolumesCloneTest-1466405401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:49 devstack sudo[99893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb Nov 03 08:25:49 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:49 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:25:49 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:49 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4e6167ed-912f-4ead-9f0a-820bd6e21b34 tempest-VolumesGetTest-1275841772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-011daa6b-94e8-48ec-8cd9-079c7ec43cee" returned: 0 in 0.560s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4e6167ed-912f-4ead-9f0a-820bd6e21b34 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-011daa6b-94e8-48ec-8cd9-079c7ec43cee {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:49 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-011daa6b-94e8-48ec-8cd9-079c7ec43cee Nov 03 08:25:49 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:49 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb" returned: 0 in 0.705s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:49 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 08:25:49 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Creating direct copy from snapshot {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 08:25:49 devstack cinder-volume[86801]: DEBUG cinder.utils [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Path /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-28c3563b-0f7d-4042-b6d4-f2c93e328dcb not found in is_blk_device check {{(pid=86801) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 08:25:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-28c3563b-0f7d-4042-b6d4-f2c93e328dcb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:49 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-86919216-d359-4e38-bf49-2abbc9beffa8 tempest-VolumesCloneTest-1466405401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.490s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:49 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-86919216-d359-4e38-bf49-2abbc9beffa8 tempest-VolumesCloneTest-1466405401 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:25:49 devstack sudo[99907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-28c3563b-0f7d-4042-b6d4-f2c93e328dcb Nov 03 08:25:49 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:49 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-86919216-d359-4e38-bf49-2abbc9beffa8 tempest-VolumesCloneTest-1466405401 None] Deleted volume successfully. Nov 03 08:25:49 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-86919216-d359-4e38-bf49-2abbc9beffa8 tempest-VolumesCloneTest-1466405401 None] Lock "cinder-9c7c4d34-d858-40cc-85e7-d316a5442022-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:25:49 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4e6167ed-912f-4ead-9f0a-820bd6e21b34 tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-011daa6b-94e8-48ec-8cd9-079c7ec43cee" returned: 0 in 0.420s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:49 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4e6167ed-912f-4ead-9f0a-820bd6e21b34 tempest-VolumesGetTest-1275841772 None] Lock "cinder-quobyte-011daa6b-94e8-48ec-8cd9-079c7ec43cee" released by "delete_volume" :: held 1.053s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:25:49 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-4e6167ed-912f-4ead-9f0a-820bd6e21b34 tempest-VolumesGetTest-1275841772 None] Created reservations ['265ad833-5d8d-45f9-8b34-3e73cef1347a', '0e743009-7a85-4728-b006-da4447476020', '8c8b06e9-76ba-42cf-8149-082ef72b0615', '46fe7332-a153-49ec-b7a7-a9f8a853c175'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:25:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4e6167ed-912f-4ead-9f0a-820bd6e21b34 tempest-VolumesGetTest-1275841772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4e6167ed-912f-4ead-9f0a-820bd6e21b34 tempest-VolumesGetTest-1275841772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:50 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4e6167ed-912f-4ead-9f0a-820bd6e21b34 tempest-VolumesGetTest-1275841772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:25:50 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4e6167ed-912f-4ead-9f0a-820bd6e21b34 tempest-VolumesGetTest-1275841772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:25:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4e6167ed-912f-4ead-9f0a-820bd6e21b34 tempest-VolumesGetTest-1275841772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4e6167ed-912f-4ead-9f0a-820bd6e21b34 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:50 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:25:50 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:50 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c18b1f1b-0f7a-4b28-b2d0-b6dbb4dde451 tempest-VolumesCloneTest-1466405401 None] Acquiring lock "cinder-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:25:50 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4e6167ed-912f-4ead-9f0a-820bd6e21b34 tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.349s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:50 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-4e6167ed-912f-4ead-9f0a-820bd6e21b34 tempest-VolumesGetTest-1275841772 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:25:50 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-4e6167ed-912f-4ead-9f0a-820bd6e21b34 tempest-VolumesGetTest-1275841772 None] Deleted volume successfully. Nov 03 08:25:50 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c18b1f1b-0f7a-4b28-b2d0-b6dbb4dde451 tempest-VolumesCloneTest-1466405401 None] Lock "cinder-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:25:50 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4e6167ed-912f-4ead-9f0a-820bd6e21b34 tempest-VolumesGetTest-1275841772 None] Lock "cinder-011daa6b-94e8-48ec-8cd9-079c7ec43cee-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:25:50 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c18b1f1b-0f7a-4b28-b2d0-b6dbb4dde451 tempest-VolumesCloneTest-1466405401 None] Acquiring lock "cinder-quobyte-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:25:50 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c18b1f1b-0f7a-4b28-b2d0-b6dbb4dde451 tempest-VolumesCloneTest-1466405401 None] Lock "cinder-quobyte-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae" acquired by "delete_volume" :: waited 0.021s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:25:50 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec3bbe2-826e-4f71-9404-50c47cfe8d48]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:25:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c18b1f1b-0f7a-4b28-b2d0-b6dbb4dde451 tempest-VolumesCloneTest-1466405401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:50 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae Nov 03 08:25:50 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:51 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e4bffc3a-025d-4201-939d-1df9889add39 tempest-VolumesGetTest-1275841772 None] Acquiring lock "cinder-f99dda5f-f973-4a32-a59c-568a256239e4-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:25:51 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e4bffc3a-025d-4201-939d-1df9889add39 tempest-VolumesGetTest-1275841772 None] Lock "cinder-f99dda5f-f973-4a32-a59c-568a256239e4-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:25:51 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e4bffc3a-025d-4201-939d-1df9889add39 tempest-VolumesGetTest-1275841772 None] Acquiring lock "cinder-quobyte-f99dda5f-f973-4a32-a59c-568a256239e4" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:25:51 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e4bffc3a-025d-4201-939d-1df9889add39 tempest-VolumesGetTest-1275841772 None] Lock "cinder-quobyte-f99dda5f-f973-4a32-a59c-568a256239e4" acquired by "delete_volume" :: waited 0.047s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:25:51 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4bf1a1-50e1-493c-8f7f-1e2e11331259]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:25:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e4bffc3a-025d-4201-939d-1df9889add39 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f99dda5f-f973-4a32-a59c-568a256239e4 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:51 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c18b1f1b-0f7a-4b28-b2d0-b6dbb4dde451 tempest-VolumesCloneTest-1466405401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae" returned: 0 in 1.379s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c18b1f1b-0f7a-4b28-b2d0-b6dbb4dde451 tempest-VolumesCloneTest-1466405401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:52 devstack sudo[99930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae Nov 03 08:25:52 devstack sudo[99930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:52 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f99dda5f-f973-4a32-a59c-568a256239e4 Nov 03 08:25:52 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:52 devstack sudo[99930]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c18b1f1b-0f7a-4b28-b2d0-b6dbb4dde451 tempest-VolumesCloneTest-1466405401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae" returned: 0 in 0.628s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:52 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c18b1f1b-0f7a-4b28-b2d0-b6dbb4dde451 tempest-VolumesCloneTest-1466405401 None] Lock "cinder-quobyte-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae" released by "delete_volume" :: held 2.170s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:25:52 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-c18b1f1b-0f7a-4b28-b2d0-b6dbb4dde451 tempest-VolumesCloneTest-1466405401 None] Created reservations ['f7f0914f-bc20-455c-a8e5-9b63f6be56f1', '32935256-5b63-4be0-9abe-16124d4f8286', 'a272d549-f7e8-4e96-9251-a12bc1ff5937', '1e582f0c-0c39-420d-9281-9429b8e27a2f'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:25:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c18b1f1b-0f7a-4b28-b2d0-b6dbb4dde451 tempest-VolumesCloneTest-1466405401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c18b1f1b-0f7a-4b28-b2d0-b6dbb4dde451 tempest-VolumesCloneTest-1466405401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c18b1f1b-0f7a-4b28-b2d0-b6dbb4dde451 tempest-VolumesCloneTest-1466405401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:25:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c18b1f1b-0f7a-4b28-b2d0-b6dbb4dde451 tempest-VolumesCloneTest-1466405401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:25:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c18b1f1b-0f7a-4b28-b2d0-b6dbb4dde451 tempest-VolumesCloneTest-1466405401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c18b1f1b-0f7a-4b28-b2d0-b6dbb4dde451 tempest-VolumesCloneTest-1466405401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:53 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:25:53 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:53 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e4bffc3a-025d-4201-939d-1df9889add39 tempest-VolumesGetTest-1275841772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f99dda5f-f973-4a32-a59c-568a256239e4" returned: 0 in 1.501s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e4bffc3a-025d-4201-939d-1df9889add39 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f99dda5f-f973-4a32-a59c-568a256239e4 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:53 devstack sudo[99939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f99dda5f-f973-4a32-a59c-568a256239e4 Nov 03 08:25:53 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:54 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c18b1f1b-0f7a-4b28-b2d0-b6dbb4dde451 tempest-VolumesCloneTest-1466405401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.829s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:54 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-c18b1f1b-0f7a-4b28-b2d0-b6dbb4dde451 tempest-VolumesCloneTest-1466405401 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:25:54 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-c18b1f1b-0f7a-4b28-b2d0-b6dbb4dde451 tempest-VolumesCloneTest-1466405401 None] Deleted volume successfully. Nov 03 08:25:54 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e4bffc3a-025d-4201-939d-1df9889add39 tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f99dda5f-f973-4a32-a59c-568a256239e4" returned: 0 in 0.734s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:54 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e4bffc3a-025d-4201-939d-1df9889add39 tempest-VolumesGetTest-1275841772 None] Lock "cinder-quobyte-f99dda5f-f973-4a32-a59c-568a256239e4" released by "delete_volume" :: held 2.385s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:25:54 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c18b1f1b-0f7a-4b28-b2d0-b6dbb4dde451 tempest-VolumesCloneTest-1466405401 None] Lock "cinder-66d3ed66-53f2-4ad8-a13f-c42cdfaa81ae-delete_volume" released by "delete_volume" :: held 3.761s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:25:54 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-e4bffc3a-025d-4201-939d-1df9889add39 tempest-VolumesGetTest-1275841772 None] Created reservations ['6f6c1ab5-4e73-4142-9579-b8d980035959', 'f45cce95-7fe0-43cd-841c-4e76d1daed0d', '1d0976b4-bdd3-4779-b526-2bee6a3b2714', 'fe64a51f-cd4e-4b25-8276-a929a10eec3f'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:25:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e4bffc3a-025d-4201-939d-1df9889add39 tempest-VolumesGetTest-1275841772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:25:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e4bffc3a-025d-4201-939d-1df9889add39 tempest-VolumesGetTest-1275841772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:25:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e4bffc3a-025d-4201-939d-1df9889add39 tempest-VolumesGetTest-1275841772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:25:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e4bffc3a-025d-4201-939d-1df9889add39 tempest-VolumesGetTest-1275841772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:25:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e4bffc3a-025d-4201-939d-1df9889add39 tempest-VolumesGetTest-1275841772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:25:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e4bffc3a-025d-4201-939d-1df9889add39 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:25:54 devstack sudo[99944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:25:54 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:25:55 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root Nov 03 08:25:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e4bffc3a-025d-4201-939d-1df9889add39 tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.866s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:25:55 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-e4bffc3a-025d-4201-939d-1df9889add39 tempest-VolumesGetTest-1275841772 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:25:55 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-e4bffc3a-025d-4201-939d-1df9889add39 tempest-VolumesGetTest-1275841772 None] Deleted volume successfully. Nov 03 08:25:55 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e4bffc3a-025d-4201-939d-1df9889add39 tempest-VolumesGetTest-1275841772 None] Lock "cinder-f99dda5f-f973-4a32-a59c-568a256239e4-delete_volume" released by "delete_volume" :: held 4.115s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:25:56 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:25:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Flow 'volume_create_manager' (ae449499-527e-4690-b274-594c6f74d7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:25:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c043e533-b441-4d93-b5ee-887d947b6fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c043e533-b441-4d93-b5ee-887d947b6fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-981332251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3089715-192d-4f68-9644-ecb618daa082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bcb0ca2055443f1817921e81f500de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:25:57Z,use_quota=True,user_id='2ba8718f77974c5aad5aa832a07e697b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5ac01c-30dd-477f-9e67-11df6d9e4427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5ac01c-30dd-477f-9e67-11df6d9e4427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fcb0229-3872-41bd-b69f-d32e5141ecfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fcb0229-3872-41bd-b69f-d32e5141ecfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3089715-192d-4f68-9644-ecb618daa082', 'volume_name': 'volume-d3089715-192d-4f68-9644-ecb618daa082', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad72553-82f4-4f44-af33-7140799b5293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad72553-82f4-4f44-af33-7140799b5293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:25:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bd077f4-29e0-4dfb-8dce-8a023a4c0833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:25:56 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Volume d3089715-192d-4f68-9644-ecb618daa082: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3089715-192d-4f68-9644-ecb618daa082', 'volume_size': 1} Nov 03 08:25:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:26:00 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-28c3563b-0f7d-4042-b6d4-f2c93e328dcb" returned: 0 in 10.830s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:00 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb, size 1024.00 MB, duration 10.83 sec, destination /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-28c3563b-0f7d-4042-b6d4-f2c93e328dcb {{(pid=86801) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 08:26:00 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Converted 1024.00 MB image at 94.54 MB/s Nov 03 08:26:00 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-28c3563b-0f7d-4042-b6d4-f2c93e328dcb is being set with open permissions: ugo+rw Nov 03 08:26:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-28c3563b-0f7d-4042-b6d4-f2c93e328dcb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:00 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-28c3563b-0f7d-4042-b6d4-f2c93e328dcb Nov 03 08:26:00 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:00 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-28c3563b-0f7d-4042-b6d4-f2c93e328dcb" returned: 0 in 0.253s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:00 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Lock "cinder-quobyte-28c3563b-0f7d-4042-b6d4-f2c93e328dcb" released by "_copy_volume_from_snapshot" :: held 12.633s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:26:00 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Lock "cinder-quobyte-9262172a-ec05-4227-8bb1-00156835f016-28c3563b-0f7d-4042-b6d4-f2c93e328dcb" released by "_create_volume_from_snapshot" :: held 12.736s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:26:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.783s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:26:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.847s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:26:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-981332251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3089715-192d-4f68-9644-ecb618daa082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bcb0ca2055443f1817921e81f500de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:25:57Z,use_quota=True,user_id='2ba8718f77974c5aad5aa832a07e697b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:26:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Creating volume d3089715-192d-4f68-9644-ecb618daa082 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:26:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:26:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:26:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:26:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:26:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:26:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:26:00 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:26:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:00 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082 1073741824 Nov 03 08:26:00 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6faa15c5-21f1-4165-99d7-697ecddc1234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28c3563b-0f7d-4042-b6d4-f2c93e328dcb', 'volume_size': 1, 'snapshot_id': '9262172a-ec05-4227-8bb1-00156835f016'}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6db7b70-3b99-4412-9fb3-f98c78fccc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:00 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Volume volume-28c3563b-0f7d-4042-b6d4-f2c93e328dcb (28c3563b-0f7d-4042-b6d4-f2c93e328dcb): created successfully Nov 03 08:26:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6db7b70-3b99-4412-9fb3-f98c78fccc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Flow 'volume_create_manager' (a86f8ca5-0ac6-428e-9150-bf133fa97c18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:26:00 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-0e5d4a7a-9261-4fa1-8055-f7aa636b3c29 tempest-TestStampPattern-1669571982 None] Created volume successfully. Nov 03 08:26:01 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082 1073741824" returned: 0 in 0.460s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:01 devstack sudo[99991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082 Nov 03 08:26:01 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:01 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082" returned: 0 in 0.255s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:01 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:26:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:26:01 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bd077f4-29e0-4dfb-8dce-8a023a4c0833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3089715-192d-4f68-9644-ecb618daa082', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:01 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a47b3f8-c367-4e6a-86a7-426660cd9c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:01 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Volume volume-d3089715-192d-4f68-9644-ecb618daa082 (d3089715-192d-4f68-9644-ecb618daa082): created successfully Nov 03 08:26:01 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a47b3f8-c367-4e6a-86a7-426660cd9c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:01 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Flow 'volume_create_manager' (ae449499-527e-4690-b274-594c6f74d7e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:26:01 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-c620cf6d-ed00-4bea-9a1d-e8862f993585 tempest-VolumesGetTest-1275841772 None] Created volume successfully. Nov 03 08:26:02 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:26:02 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Flow 'volume_create_manager' (96745ef1-4bb6-49fb-8985-b24b4d7fa5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:26:02 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3091768-b3f5-44f7-8ba5-1325bf1cf85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:02 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3091768-b3f5-44f7-8ba5-1325bf1cf85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-29867098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585be031-aec0-40c4-acc1-95f5b95a4cc4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8bcb0ca2055443f1817921e81f500de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d3089715-192d-4f68-9644-ecb618daa082,status='creating',terminated_at=None,updated_at=2026-11-03T07:26:03Z,use_quota=True,user_id='2ba8718f77974c5aad5aa832a07e697b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:02 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f4261a-c182-43a5-9986-382c5f77e51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:02 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f4261a-c182-43a5-9986-382c5f77e51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:02 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001ba1ae-7d10-4ad3-acd6-25cbfa578a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:02 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001ba1ae-7d10-4ad3-acd6-25cbfa578a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '585be031-aec0-40c4-acc1-95f5b95a4cc4', 'volume_name': 'volume-585be031-aec0-40c4-acc1-95f5b95a4cc4', 'volume_size': 1, 'source_volid': 'd3089715-192d-4f68-9644-ecb618daa082', 'source_volstatus': 'available'}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:02 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f87f200-5716-4b8f-bad4-92c97e9387c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:02 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f87f200-5716-4b8f-bad4-92c97e9387c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:02 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91b52e20-672e-40ed-ba53-4a353ac97f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:02 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Volume 585be031-aec0-40c4-acc1-95f5b95a4cc4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-585be031-aec0-40c4-acc1-95f5b95a4cc4', 'volume_size': 1, 'source_volid': 'd3089715-192d-4f68-9644-ecb618daa082', 'source_volstatus': 'available'} Nov 03 08:26:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:26:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:26:02 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Cloning volume d3089715-192d-4f68-9644-ecb618daa082 to volume 585be031-aec0-40c4-acc1-95f5b95a4cc4 Nov 03 08:26:02 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Creating offline snapshot ddfd48cb-c52f-4863-bea5-3b3125f1f590 of volume d3089715-192d-4f68-9644-ecb618daa082 {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:26:02 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2831b35-9944-4e47-87ad-3b654c60929b]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:26:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:02 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082 Nov 03 08:26:02 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:03 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082" returned: 0 in 0.375s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.ddfd48cb-c52f-4863-bea5-3b3125f1f590 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:03 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.ddfd48cb-c52f-4863-bea5-3b3125f1f590 1G Nov 03 08:26:03 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:03 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.ddfd48cb-c52f-4863-bea5-3b3125f1f590 1G" returned: 0 in 0.435s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3089715-192d-4f68-9644-ecb618daa082 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.ddfd48cb-c52f-4863-bea5-3b3125f1f590 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:03 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3089715-192d-4f68-9644-ecb618daa082 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.ddfd48cb-c52f-4863-bea5-3b3125f1f590 Nov 03 08:26:03 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:03 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:26:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:26:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:26:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:26:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:26:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:26:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:03 devstack sudo[100007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:26:03 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:03 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3089715-192d-4f68-9644-ecb618daa082 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.ddfd48cb-c52f-4863-bea5-3b3125f1f590" returned: 0 in 0.316s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:04 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.ddfd48cb-c52f-4863-bea5-3b3125f1f590 is being set with open permissions: ugo+rw Nov 03 08:26:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.ddfd48cb-c52f-4863-bea5-3b3125f1f590 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:04 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.286s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:04 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:26:04 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager._thread_info {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:26:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread count: 29 {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 08:26:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread info: [<_MainThread(MainThread, started 139707544170624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 08:26:04 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.ddfd48cb-c52f-4863-bea5-3b3125f1f590 Nov 03 08:26:04 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:04 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.ddfd48cb-c52f-4863-bea5-3b3125f1f590" returned: 0 in 0.264s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:04 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.info Nov 03 08:26:04 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:04 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.info" returned: 0 in 0.253s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:04 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.info is being set with open permissions: ugo+rw Nov 03 08:26:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:04 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.info Nov 03 08:26:04 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:04 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.info" returned: 0 in 0.245s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Acquiring lock "cinder-quobyte-585be031-aec0-40c4-acc1-95f5b95a4cc4" by "_copy_volume_from_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:26:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Lock "cinder-quobyte-585be031-aec0-40c4-acc1-95f5b95a4cc4" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:26:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] snapshot: ddfd48cb-c52f-4863-bea5-3b3125f1f590, volume: 585be031-aec0-40c4-acc1-95f5b95a4cc4, {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 08:26:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:26:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:26:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:26:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:26:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:26:04 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[809665a4-f544-4547-bf39-1af6bfeb6cbe]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:26:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.ddfd48cb-c52f-4863-bea5-3b3125f1f590 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:04 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.ddfd48cb-c52f-4863-bea5-3b3125f1f590 Nov 03 08:26:04 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:05 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:26:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Flow 'volume_create_manager' (c4a079a8-2146-4c1e-85ee-c421f3e89470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:26:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e52e04-e692-441f-89b6-49c88dcf9bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e52e04-e692-441f-89b6-49c88dcf9bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2003713369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1d3f95-c486-43e6-ab26-9be640780e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='900cf8237e8b468eb7b7d0eb3acdd599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:26:05Z,use_quota=True,user_id='86f66442064548ffb0344df89da6cc27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a689e190-260f-4352-9d2a-56d18ed2aaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a689e190-260f-4352-9d2a-56d18ed2aaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e413998-d3b1-435e-81ba-39e7bfb2515b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e413998-d3b1-435e-81ba-39e7bfb2515b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de1d3f95-c486-43e6-ab26-9be640780e65', 'volume_name': 'volume-de1d3f95-c486-43e6-ab26-9be640780e65', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47ccd28-0357-49f5-b528-91b58f3b8a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47ccd28-0357-49f5-b528-91b58f3b8a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3059379f-d475-44a8-b016-77047bf126f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:05 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Volume de1d3f95-c486-43e6-ab26-9be640780e65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de1d3f95-c486-43e6-ab26-9be640780e65', 'volume_size': 1} Nov 03 08:26:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:26:05 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.ddfd48cb-c52f-4863-bea5-3b3125f1f590" returned: 0 in 0.357s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:05 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3089715-192d-4f68-9644-ecb618daa082(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:26:05 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cc02fe-607c-4ca8-b873-7a3f4fef36f4]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:26:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:05 devstack sudo[100033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082 Nov 03 08:26:05 devstack sudo[100033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:05 devstack sudo[100033]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082" returned: 0 in 0.356s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:05 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082 {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 08:26:05 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Creating direct copy from snapshot {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 08:26:05 devstack cinder-volume[86801]: DEBUG cinder.utils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Path /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-585be031-aec0-40c4-acc1-95f5b95a4cc4 not found in is_blk_device check {{(pid=86801) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 08:26:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-585be031-aec0-40c4-acc1-95f5b95a4cc4 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:05 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-585be031-aec0-40c4-acc1-95f5b95a4cc4 Nov 03 08:26:05 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:12 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-585be031-aec0-40c4-acc1-95f5b95a4cc4" returned: 0 in 6.459s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:12 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082, size 1024.00 MB, duration 6.46 sec, destination /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-585be031-aec0-40c4-acc1-95f5b95a4cc4 {{(pid=86801) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 08:26:12 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Converted 1024.00 MB image at 158.51 MB/s Nov 03 08:26:12 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-585be031-aec0-40c4-acc1-95f5b95a4cc4 is being set with open permissions: ugo+rw Nov 03 08:26:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-585be031-aec0-40c4-acc1-95f5b95a4cc4 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:12 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-585be031-aec0-40c4-acc1-95f5b95a4cc4 Nov 03 08:26:12 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:12 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-585be031-aec0-40c4-acc1-95f5b95a4cc4" returned: 0 in 0.254s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:12 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Lock "cinder-quobyte-585be031-aec0-40c4-acc1-95f5b95a4cc4" released by "_copy_volume_from_snapshot" :: held 7.512s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:26:12 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Acquiring lock "cinder-quobyte-ddfd48cb-c52f-4863-bea5-3b3125f1f590" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:26:12 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Lock "cinder-quobyte-ddfd48cb-c52f-4863-bea5-3b3125f1f590" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:26:12 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Deleting offline snapshot ddfd48cb-c52f-4863-bea5-3b3125f1f590 of volume d3089715-192d-4f68-9644-ecb618daa082 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:26:12 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] snapshot_file for this snap is: volume-d3089715-192d-4f68-9644-ecb618daa082.ddfd48cb-c52f-4863-bea5-3b3125f1f590 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:26:12 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6b72bd-5eaa-45e8-8767-f1b9f709d16f]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:26:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.ddfd48cb-c52f-4863-bea5-3b3125f1f590 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:12 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.ddfd48cb-c52f-4863-bea5-3b3125f1f590 Nov 03 08:26:12 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:12 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.ddfd48cb-c52f-4863-bea5-3b3125f1f590" returned: 0 in 0.381s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:12 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3089715-192d-4f68-9644-ecb618daa082(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:26:12 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f59ebb-fcb3-432a-be37-9d35790f78e8]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:26:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:12 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082 Nov 03 08:26:12 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:13 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082" returned: 0 in 0.562s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.ddfd48cb-c52f-4863-bea5-3b3125f1f590 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:13 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.ddfd48cb-c52f-4863-bea5-3b3125f1f590 Nov 03 08:26:13 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:13 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.ddfd48cb-c52f-4863-bea5-3b3125f1f590" returned: 0 in 0.355s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.ddfd48cb-c52f-4863-bea5-3b3125f1f590 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:13 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.ddfd48cb-c52f-4863-bea5-3b3125f1f590 Nov 03 08:26:13 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:13 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082.ddfd48cb-c52f-4863-bea5-3b3125f1f590" returned: 0 in 0.255s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Lock "cinder-quobyte-ddfd48cb-c52f-4863-bea5-3b3125f1f590" released by "_delete_snapshot" :: held 1.655s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.257s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.970s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2003713369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1d3f95-c486-43e6-ab26-9be640780e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='900cf8237e8b468eb7b7d0eb3acdd599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:26:05Z,use_quota=True,user_id='86f66442064548ffb0344df89da6cc27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Creating volume de1d3f95-c486-43e6-ab26-9be640780e65 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:26:14 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-de1d3f95-c486-43e6-ab26-9be640780e65 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91b52e20-672e-40ed-ba53-4a353ac97f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-585be031-aec0-40c4-acc1-95f5b95a4cc4', 'volume_size': 1, 'source_volid': 'd3089715-192d-4f68-9644-ecb618daa082', 'source_volstatus': 'available'}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ccfb973-f23d-47fd-94aa-a6177ddb5214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:14 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-de1d3f95-c486-43e6-ab26-9be640780e65 1073741824 Nov 03 08:26:14 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:14 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Volume volume-585be031-aec0-40c4-acc1-95f5b95a4cc4 (585be031-aec0-40c4-acc1-95f5b95a4cc4): created successfully Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ccfb973-f23d-47fd-94aa-a6177ddb5214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Flow 'volume_create_manager' (96745ef1-4bb6-49fb-8985-b24b4d7fa5e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:26:14 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-185bab1e-59ff-4575-8a71-261d726091f4 tempest-VolumesGetTest-1275841772 None] Created volume successfully. Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-f21a5312-7f0d-4ef4-8361-94f19a27931b req-13e32b2d-29aa-428a-bdc2-dd79a43e9c2f tempest-TestStampPattern-1669571982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:26:14 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-de1d3f95-c486-43e6-ab26-9be640780e65 1073741824" returned: 0 in 0.458s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-de1d3f95-c486-43e6-ab26-9be640780e65 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:14 devstack sudo[100132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-de1d3f95-c486-43e6-ab26-9be640780e65 Nov 03 08:26:14 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:14 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-de1d3f95-c486-43e6-ab26-9be640780e65" returned: 0 in 0.251s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-f21a5312-7f0d-4ef4-8361-94f19a27931b req-13e32b2d-29aa-428a-bdc2-dd79a43e9c2f tempest-TestStampPattern-1669571982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.475s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3059379f-d475-44a8-b016-77047bf126f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de1d3f95-c486-43e6-ab26-9be640780e65', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ebf899d-1953-4404-a8f5-527fe342d8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-f21a5312-7f0d-4ef4-8361-94f19a27931b req-13e32b2d-29aa-428a-bdc2-dd79a43e9c2f tempest-TestStampPattern-1669571982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:26:14 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Volume volume-de1d3f95-c486-43e6-ab26-9be640780e65 (de1d3f95-c486-43e6-ab26-9be640780e65): created successfully Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ebf899d-1953-4404-a8f5-527fe342d8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Flow 'volume_create_manager' (c4a079a8-2146-4c1e-85ee-c421f3e89470) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:26:14 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-5340a498-1344-499f-bae3-7c93b7991dd7 tempest-VolumesNegativeTest-1179837335 None] Created volume successfully. Nov 03 08:26:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-f21a5312-7f0d-4ef4-8361-94f19a27931b req-13e32b2d-29aa-428a-bdc2-dd79a43e9c2f tempest-TestStampPattern-1669571982 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f', 'name': 'volume-28c3563b-0f7d-4042-b6d4-f2c93e328dcb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b27ed09-e184-4831-908b-8145e671681d', 'enforce_multipath': True} {{(pid=86801) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 08:26:14 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-f21a5312-7f0d-4ef4-8361-94f19a27931b req-13e32b2d-29aa-428a-bdc2-dd79a43e9c2f tempest-TestStampPattern-1669571982 None] attachment_update completed successfully. Nov 03 08:26:15 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:26:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Flow 'volume_create_manager' (2130dd6c-7211-4739-8f30-f61bbd1f7b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:26:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2becd3c-673f-43cf-a9c1-2e3401352c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2becd3c-673f-43cf-a9c1-2e3401352c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:26:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-817295931',display_name='tempest-VolumesGetTest-Volume-1995924162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c46e7c-34c7-454f-af60-2a29dc961295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bcb0ca2055443f1817921e81f500de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:26:15Z,use_quota=True,user_id='2ba8718f77974c5aad5aa832a07e697b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21dcf386-bbba-4ba3-a5fa-18537f90ba0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21dcf386-bbba-4ba3-a5fa-18537f90ba0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d275257-c29e-4114-9664-306a9c7a7965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d275257-c29e-4114-9664-306a9c7a7965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40c46e7c-34c7-454f-af60-2a29dc961295', 'volume_name': 'volume-40c46e7c-34c7-454f-af60-2a29dc961295', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d8d410d-24af-4439-95a3-e759987958e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d8d410d-24af-4439-95a3-e759987958e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e9956e1-23c9-4e6f-a7e8-1114509f39a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:15 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Volume 40c46e7c-34c7-454f-af60-2a29dc961295: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40c46e7c-34c7-454f-af60-2a29dc961295', 'volume_size': 1} Nov 03 08:26:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:26:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:26:15 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:26:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-817295931',display_name='tempest-VolumesGetTest-Volume-1995924162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c46e7c-34c7-454f-af60-2a29dc961295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bcb0ca2055443f1817921e81f500de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:26:15Z,use_quota=True,user_id='2ba8718f77974c5aad5aa832a07e697b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:26:15 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Creating volume 40c46e7c-34c7-454f-af60-2a29dc961295 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:26:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:26:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:26:15 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:26:15 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:26:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:26:15 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:26:15 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:26:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-40c46e7c-34c7-454f-af60-2a29dc961295 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:15 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-40c46e7c-34c7-454f-af60-2a29dc961295 1073741824 Nov 03 08:26:15 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:15 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-40c46e7c-34c7-454f-af60-2a29dc961295 1073741824" returned: 0 in 0.569s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-40c46e7c-34c7-454f-af60-2a29dc961295 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:16 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-40c46e7c-34c7-454f-af60-2a29dc961295 Nov 03 08:26:16 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:16 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-40c46e7c-34c7-454f-af60-2a29dc961295" returned: 0 in 0.274s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:26:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:26:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e9956e1-23c9-4e6f-a7e8-1114509f39a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40c46e7c-34c7-454f-af60-2a29dc961295', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a88595f-6601-4629-bcd3-71303cee10e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:16 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Volume volume-40c46e7c-34c7-454f-af60-2a29dc961295 (40c46e7c-34c7-454f-af60-2a29dc961295): created successfully Nov 03 08:26:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a88595f-6601-4629-bcd3-71303cee10e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Flow 'volume_create_manager' (2130dd6c-7211-4739-8f30-f61bbd1f7b1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:26:16 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-9e89f11e-6a3a-42f9-bb82-19ea22d9a2ed tempest-VolumesGetTest-1275841772 None] Created volume successfully. Nov 03 08:26:17 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-818b8e84-d34c-4f44-819a-661ce1ff6dca tempest-VolumesGetTest-1275841772 None] Acquiring lock "cinder-40c46e7c-34c7-454f-af60-2a29dc961295-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:26:17 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-818b8e84-d34c-4f44-819a-661ce1ff6dca tempest-VolumesGetTest-1275841772 None] Lock "cinder-40c46e7c-34c7-454f-af60-2a29dc961295-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:26:17 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-818b8e84-d34c-4f44-819a-661ce1ff6dca tempest-VolumesGetTest-1275841772 None] Acquiring lock "cinder-quobyte-40c46e7c-34c7-454f-af60-2a29dc961295" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:26:17 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-818b8e84-d34c-4f44-819a-661ce1ff6dca tempest-VolumesGetTest-1275841772 None] Lock "cinder-quobyte-40c46e7c-34c7-454f-af60-2a29dc961295" acquired by "delete_volume" :: waited 0.028s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:26:17 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5d71fc-5713-4122-a637-69b94000fddc]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:26:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-818b8e84-d34c-4f44-819a-661ce1ff6dca tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-40c46e7c-34c7-454f-af60-2a29dc961295 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:17 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-40c46e7c-34c7-454f-af60-2a29dc961295 Nov 03 08:26:17 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:18 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-3c432e9c-dc2b-439f-a4a0-d3236f578fae req-f842bb22-ffd7-4948-9270-c0c7f07d27e2 tempest-TestStampPattern-1669571982 None] Terminate volume connection completed successfully. Nov 03 08:26:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-3c432e9c-dc2b-439f-a4a0-d3236f578fae req-f842bb22-ffd7-4948-9270-c0c7f07d27e2 tempest-TestStampPattern-1669571982 None] Deleting attachment 3b27ed09-e184-4831-908b-8145e671681d. {{(pid=86801) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 08:26:18 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-818b8e84-d34c-4f44-819a-661ce1ff6dca tempest-VolumesGetTest-1275841772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-40c46e7c-34c7-454f-af60-2a29dc961295" returned: 0 in 0.547s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-818b8e84-d34c-4f44-819a-661ce1ff6dca tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-40c46e7c-34c7-454f-af60-2a29dc961295 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:18 devstack sudo[100614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-40c46e7c-34c7-454f-af60-2a29dc961295 Nov 03 08:26:18 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:18 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-818b8e84-d34c-4f44-819a-661ce1ff6dca tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-40c46e7c-34c7-454f-af60-2a29dc961295" returned: 0 in 0.309s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:18 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-818b8e84-d34c-4f44-819a-661ce1ff6dca tempest-VolumesGetTest-1275841772 None] Lock "cinder-quobyte-40c46e7c-34c7-454f-af60-2a29dc961295" released by "delete_volume" :: held 0.928s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:26:18 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-818b8e84-d34c-4f44-819a-661ce1ff6dca tempest-VolumesGetTest-1275841772 None] Created reservations ['35c79cd9-c371-46ea-a369-b2b334578608', '29ab0f08-4578-4c7e-b24f-d09cd10ac0fc', '9645cccf-79e1-4901-8246-d828e9efaabd', '580bc987-22a8-4b8d-9c86-87a9ece3b4b0'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:26:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-818b8e84-d34c-4f44-819a-661ce1ff6dca tempest-VolumesGetTest-1275841772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:26:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-818b8e84-d34c-4f44-819a-661ce1ff6dca tempest-VolumesGetTest-1275841772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:26:18 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-818b8e84-d34c-4f44-819a-661ce1ff6dca tempest-VolumesGetTest-1275841772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:26:18 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-818b8e84-d34c-4f44-819a-661ce1ff6dca tempest-VolumesGetTest-1275841772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:26:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-818b8e84-d34c-4f44-819a-661ce1ff6dca tempest-VolumesGetTest-1275841772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:26:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-818b8e84-d34c-4f44-819a-661ce1ff6dca tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:18 devstack sudo[100630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:26:18 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:19 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-818b8e84-d34c-4f44-819a-661ce1ff6dca tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.296s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:19 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-818b8e84-d34c-4f44-819a-661ce1ff6dca tempest-VolumesGetTest-1275841772 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:26:19 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-818b8e84-d34c-4f44-819a-661ce1ff6dca tempest-VolumesGetTest-1275841772 None] Deleted volume successfully. Nov 03 08:26:19 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-818b8e84-d34c-4f44-819a-661ce1ff6dca tempest-VolumesGetTest-1275841772 None] Lock "cinder-40c46e7c-34c7-454f-af60-2a29dc961295-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:26:19 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-008c81b2-c773-4492-b5cd-f0dbdef984c3 tempest-VolumesGetTest-1275841772 None] Acquiring lock "cinder-585be031-aec0-40c4-acc1-95f5b95a4cc4-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:26:20 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-008c81b2-c773-4492-b5cd-f0dbdef984c3 tempest-VolumesGetTest-1275841772 None] Lock "cinder-585be031-aec0-40c4-acc1-95f5b95a4cc4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:26:20 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-008c81b2-c773-4492-b5cd-f0dbdef984c3 tempest-VolumesGetTest-1275841772 None] Acquiring lock "cinder-quobyte-585be031-aec0-40c4-acc1-95f5b95a4cc4" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:26:20 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-008c81b2-c773-4492-b5cd-f0dbdef984c3 tempest-VolumesGetTest-1275841772 None] Lock "cinder-quobyte-585be031-aec0-40c4-acc1-95f5b95a4cc4" acquired by "delete_volume" :: waited 0.026s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:26:20 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4198663-6df1-4685-a623-abee0d1d4014]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:26:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-008c81b2-c773-4492-b5cd-f0dbdef984c3 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-585be031-aec0-40c4-acc1-95f5b95a4cc4 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:20 devstack sudo[100639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-585be031-aec0-40c4-acc1-95f5b95a4cc4 Nov 03 08:26:20 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:20 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-008c81b2-c773-4492-b5cd-f0dbdef984c3 tempest-VolumesGetTest-1275841772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-585be031-aec0-40c4-acc1-95f5b95a4cc4" returned: 0 in 0.758s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-008c81b2-c773-4492-b5cd-f0dbdef984c3 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-585be031-aec0-40c4-acc1-95f5b95a4cc4 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:20 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-585be031-aec0-40c4-acc1-95f5b95a4cc4 Nov 03 08:26:20 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:21 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-008c81b2-c773-4492-b5cd-f0dbdef984c3 tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-585be031-aec0-40c4-acc1-95f5b95a4cc4" returned: 0 in 0.469s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:21 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-008c81b2-c773-4492-b5cd-f0dbdef984c3 tempest-VolumesGetTest-1275841772 None] Lock "cinder-quobyte-585be031-aec0-40c4-acc1-95f5b95a4cc4" released by "delete_volume" :: held 1.308s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:26:21 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-008c81b2-c773-4492-b5cd-f0dbdef984c3 tempest-VolumesGetTest-1275841772 None] Created reservations ['f8b2e39a-40bc-437d-b18c-e659821b2b46', '1a142dc5-2965-4ef4-9eac-b818801206fe', '1bec9fed-78ce-4b29-934b-8745aa83ce59', '9022785f-fba9-4679-8fbc-1e9fca7d3f92'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:26:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-008c81b2-c773-4492-b5cd-f0dbdef984c3 tempest-VolumesGetTest-1275841772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:26:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-008c81b2-c773-4492-b5cd-f0dbdef984c3 tempest-VolumesGetTest-1275841772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:26:21 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-008c81b2-c773-4492-b5cd-f0dbdef984c3 tempest-VolumesGetTest-1275841772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:26:21 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-008c81b2-c773-4492-b5cd-f0dbdef984c3 tempest-VolumesGetTest-1275841772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:26:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-008c81b2-c773-4492-b5cd-f0dbdef984c3 tempest-VolumesGetTest-1275841772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:26:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-008c81b2-c773-4492-b5cd-f0dbdef984c3 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:21 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:26:21 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:22 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-008c81b2-c773-4492-b5cd-f0dbdef984c3 tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.343s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:22 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-008c81b2-c773-4492-b5cd-f0dbdef984c3 tempest-VolumesGetTest-1275841772 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:26:22 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-008c81b2-c773-4492-b5cd-f0dbdef984c3 tempest-VolumesGetTest-1275841772 None] Deleted volume successfully. Nov 03 08:26:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-008c81b2-c773-4492-b5cd-f0dbdef984c3 tempest-VolumesGetTest-1275841772 None] Lock "cinder-585be031-aec0-40c4-acc1-95f5b95a4cc4-delete_volume" released by "delete_volume" :: held 2.075s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:26:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5499417c-e3e7-4f7c-93b4-a089c6958e2d tempest-VolumesGetTest-1275841772 None] Acquiring lock "cinder-d3089715-192d-4f68-9644-ecb618daa082-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:26:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5499417c-e3e7-4f7c-93b4-a089c6958e2d tempest-VolumesGetTest-1275841772 None] Lock "cinder-d3089715-192d-4f68-9644-ecb618daa082-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:26:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5499417c-e3e7-4f7c-93b4-a089c6958e2d tempest-VolumesGetTest-1275841772 None] Acquiring lock "cinder-quobyte-d3089715-192d-4f68-9644-ecb618daa082" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:26:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5499417c-e3e7-4f7c-93b4-a089c6958e2d tempest-VolumesGetTest-1275841772 None] Lock "cinder-quobyte-d3089715-192d-4f68-9644-ecb618daa082" acquired by "delete_volume" :: waited 0.063s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:26:22 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[958d559f-918b-48a8-8897-ef3a966fbbdb]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:26:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5499417c-e3e7-4f7c-93b4-a089c6958e2d tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:22 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082 Nov 03 08:26:22 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-061e19ee-2985-494d-8d7f-c8a7984ba30c tempest-TestStampPattern-1669571982 None] Acquiring lock "cinder-28c3563b-0f7d-4042-b6d4-f2c93e328dcb-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:26:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-061e19ee-2985-494d-8d7f-c8a7984ba30c tempest-TestStampPattern-1669571982 None] Lock "cinder-28c3563b-0f7d-4042-b6d4-f2c93e328dcb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:26:23 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-061e19ee-2985-494d-8d7f-c8a7984ba30c tempest-TestStampPattern-1669571982 None] Acquiring lock "cinder-quobyte-28c3563b-0f7d-4042-b6d4-f2c93e328dcb" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:26:23 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-061e19ee-2985-494d-8d7f-c8a7984ba30c tempest-TestStampPattern-1669571982 None] Lock "cinder-quobyte-28c3563b-0f7d-4042-b6d4-f2c93e328dcb" acquired by "delete_volume" :: waited 0.035s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:26:23 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[46052c81-e99e-4f41-9c17-a190ba9ce9ef]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:26:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-061e19ee-2985-494d-8d7f-c8a7984ba30c tempest-TestStampPattern-1669571982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-28c3563b-0f7d-4042-b6d4-f2c93e328dcb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:23 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-28c3563b-0f7d-4042-b6d4-f2c93e328dcb Nov 03 08:26:23 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:23 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5499417c-e3e7-4f7c-93b4-a089c6958e2d tempest-VolumesGetTest-1275841772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082" returned: 0 in 0.782s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5499417c-e3e7-4f7c-93b4-a089c6958e2d tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:23 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082 Nov 03 08:26:23 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:23 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5499417c-e3e7-4f7c-93b4-a089c6958e2d tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d3089715-192d-4f68-9644-ecb618daa082" returned: 0 in 0.467s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:23 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5499417c-e3e7-4f7c-93b4-a089c6958e2d tempest-VolumesGetTest-1275841772 None] Lock "cinder-quobyte-d3089715-192d-4f68-9644-ecb618daa082" released by "delete_volume" :: held 1.387s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:26:23 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-5499417c-e3e7-4f7c-93b4-a089c6958e2d tempest-VolumesGetTest-1275841772 None] Created reservations ['9aec09af-1d63-41a8-899b-c212540f89ec', 'ec88ec44-c49d-4bf3-94d9-6ca8f18640a8', 'ef2765c4-2171-4d54-8957-ca32987a75b4', '23989fb5-b602-4e98-9a66-1c96c55f0d22'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:26:23 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-061e19ee-2985-494d-8d7f-c8a7984ba30c tempest-TestStampPattern-1669571982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-28c3563b-0f7d-4042-b6d4-f2c93e328dcb" returned: 0 in 0.854s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-061e19ee-2985-494d-8d7f-c8a7984ba30c tempest-TestStampPattern-1669571982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-28c3563b-0f7d-4042-b6d4-f2c93e328dcb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:23 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-28c3563b-0f7d-4042-b6d4-f2c93e328dcb Nov 03 08:26:23 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5499417c-e3e7-4f7c-93b4-a089c6958e2d tempest-VolumesGetTest-1275841772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:26:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5499417c-e3e7-4f7c-93b4-a089c6958e2d tempest-VolumesGetTest-1275841772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:26:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5499417c-e3e7-4f7c-93b4-a089c6958e2d tempest-VolumesGetTest-1275841772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:26:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5499417c-e3e7-4f7c-93b4-a089c6958e2d tempest-VolumesGetTest-1275841772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:26:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5499417c-e3e7-4f7c-93b4-a089c6958e2d tempest-VolumesGetTest-1275841772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:26:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5499417c-e3e7-4f7c-93b4-a089c6958e2d tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:24 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:26:24 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:24 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-061e19ee-2985-494d-8d7f-c8a7984ba30c tempest-TestStampPattern-1669571982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-28c3563b-0f7d-4042-b6d4-f2c93e328dcb" returned: 0 in 0.319s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:24 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-061e19ee-2985-494d-8d7f-c8a7984ba30c tempest-TestStampPattern-1669571982 None] Lock "cinder-quobyte-28c3563b-0f7d-4042-b6d4-f2c93e328dcb" released by "delete_volume" :: held 1.273s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:26:24 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-061e19ee-2985-494d-8d7f-c8a7984ba30c tempest-TestStampPattern-1669571982 None] Created reservations ['524c1c5d-d735-4cb0-bf66-3eb68e5b8f56', 'e96d8a2f-ff7f-49be-bae4-c0fe9031d0ab', '69b8adfd-f9d3-42f6-aeea-78072f0f40ae', '48308dcb-3b70-4c8f-a8ec-9151054d048c'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:26:24 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5499417c-e3e7-4f7c-93b4-a089c6958e2d tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.315s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:24 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-5499417c-e3e7-4f7c-93b4-a089c6958e2d tempest-VolumesGetTest-1275841772 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:26:24 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-5499417c-e3e7-4f7c-93b4-a089c6958e2d tempest-VolumesGetTest-1275841772 None] Deleted volume successfully. Nov 03 08:26:24 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5499417c-e3e7-4f7c-93b4-a089c6958e2d tempest-VolumesGetTest-1275841772 None] Lock "cinder-d3089715-192d-4f68-9644-ecb618daa082-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:26:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-061e19ee-2985-494d-8d7f-c8a7984ba30c tempest-TestStampPattern-1669571982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:26:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-061e19ee-2985-494d-8d7f-c8a7984ba30c tempest-TestStampPattern-1669571982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:26:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-061e19ee-2985-494d-8d7f-c8a7984ba30c tempest-TestStampPattern-1669571982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:26:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-061e19ee-2985-494d-8d7f-c8a7984ba30c tempest-TestStampPattern-1669571982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:26:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-061e19ee-2985-494d-8d7f-c8a7984ba30c tempest-TestStampPattern-1669571982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:26:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-061e19ee-2985-494d-8d7f-c8a7984ba30c tempest-TestStampPattern-1669571982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:24 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:26:24 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:24 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-061e19ee-2985-494d-8d7f-c8a7984ba30c tempest-TestStampPattern-1669571982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.269s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:24 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-061e19ee-2985-494d-8d7f-c8a7984ba30c tempest-TestStampPattern-1669571982 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:26:24 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-061e19ee-2985-494d-8d7f-c8a7984ba30c tempest-TestStampPattern-1669571982 None] Deleted volume successfully. Nov 03 08:26:24 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-061e19ee-2985-494d-8d7f-c8a7984ba30c tempest-TestStampPattern-1669571982 None] Lock "cinder-28c3563b-0f7d-4042-b6d4-f2c93e328dcb-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:26:25 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:26:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Flow 'volume_create_manager' (b842adba-db26-498b-87ae-630aa2e399b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:26:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (041b9af8-af87-4fe2-9d2e-680271fe74a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (041b9af8-af87-4fe2-9d2e-680271fe74a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1035423891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8bcb0ca2055443f1817921e81f500de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:26:25Z,use_quota=True,user_id='2ba8718f77974c5aad5aa832a07e697b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866dd4a6-e172-4ee9-bec4-363acf292e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866dd4a6-e172-4ee9-bec4-363acf292e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b612a21-644d-46b1-a53c-5e148bd51cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:25 devstack cinder-volume[86801]: DEBUG cinder.image.glance [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Creating Keystone auth plugin from conf {{(pid=86801) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 08:26:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c65da72a-538f-4db9-b8c7-5ae2766115f0 tempest-TestStampPattern-1669571982 None] Acquiring lock "cinder-9262172a-ec05-4227-8bb1-00156835f016-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:26:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c65da72a-538f-4db9-b8c7-5ae2766115f0 tempest-TestStampPattern-1669571982 None] Lock "cinder-9262172a-ec05-4227-8bb1-00156835f016-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:26:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c65da72a-538f-4db9-b8c7-5ae2766115f0 tempest-TestStampPattern-1669571982 None] Acquiring lock "cinder-quobyte-662df0ef-8a4d-4103-a44e-200bd24397fb" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:26:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c65da72a-538f-4db9-b8c7-5ae2766115f0 tempest-TestStampPattern-1669571982 None] Lock "cinder-quobyte-662df0ef-8a4d-4103-a44e-200bd24397fb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:26:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c65da72a-538f-4db9-b8c7-5ae2766115f0 tempest-TestStampPattern-1669571982 None] Acquiring lock "cinder-quobyte-9262172a-ec05-4227-8bb1-00156835f016" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:26:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c65da72a-538f-4db9-b8c7-5ae2766115f0 tempest-TestStampPattern-1669571982 None] Lock "cinder-quobyte-9262172a-ec05-4227-8bb1-00156835f016" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:26:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-c65da72a-538f-4db9-b8c7-5ae2766115f0 tempest-TestStampPattern-1669571982 None] Deleting offline snapshot 9262172a-ec05-4227-8bb1-00156835f016 of volume 662df0ef-8a4d-4103-a44e-200bd24397fb {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:26:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-c65da72a-538f-4db9-b8c7-5ae2766115f0 tempest-TestStampPattern-1669571982 None] snapshot_file for this snap is: volume-662df0ef-8a4d-4103-a44e-200bd24397fb.9262172a-ec05-4227-8bb1-00156835f016 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:26:25 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[4900b9f5-b248-48d5-a47a-3b01ae33d630]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:26:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c65da72a-538f-4db9-b8c7-5ae2766115f0 tempest-TestStampPattern-1669571982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.9262172a-ec05-4227-8bb1-00156835f016 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:25 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.9262172a-ec05-4227-8bb1-00156835f016 Nov 03 08:26:25 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b612a21-644d-46b1-a53c-5e148bd51cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01', 'volume_name': 'volume-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01', 'volume_size': 1, 'image_id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02c779626a284994918db1738b55fe79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'created_at': datetime.datetime(2026, 11, 3, 7, 8, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 8, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9eb5e936-be4c-46be-8de8-899e9fc38d33/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47dcb61a-2230-4ece-982f-69b16f7ab3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47dcb61a-2230-4ece-982f-69b16f7ab3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa1ad4b-c8d4-4dfe-8d2f-a1743c7a787c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:26 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Volume 6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01', 'volume_size': 1, 'image_id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02c779626a284994918db1738b55fe79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'created_at': datetime.datetime(2026, 11, 3, 7, 8, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 8, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9eb5e936-be4c-46be-8de8-899e9fc38d33/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 08:26:26 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Trying to clone 6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01 from image 9eb5e936-be4c-46be-8de8-899e9fc38d33 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}]). {{(pid=86801) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 08:26:26 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c65da72a-538f-4db9-b8c7-5ae2766115f0 tempest-TestStampPattern-1669571982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.9262172a-ec05-4227-8bb1-00156835f016" returned: 0 in 0.685s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:26 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-c65da72a-538f-4db9-b8c7-5ae2766115f0 tempest-TestStampPattern-1669571982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-662df0ef-8a4d-4103-a44e-200bd24397fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:26:26 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[935c0702-7556-4db3-ba0c-948ef3b21aff]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:26:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c65da72a-538f-4db9-b8c7-5ae2766115f0 tempest-TestStampPattern-1669571982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:26 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_sde2wbfidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 08:26:26 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Image download 20.69 MB at 20.69 MB/s Nov 03 08:26:26 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb Nov 03 08:26:26 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:26 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[4542581a-1e78-4559-9d16-594305c071de]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:26:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_sde2wbfidevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:26 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_sde2wbfidevstack@QuobyteHD Nov 03 08:26:26 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:27 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_sde2wbfidevstack@QuobyteHD" returned: 0 in 0.522s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:27 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Temporary image 9eb5e936-be4c-46be-8de8-899e9fc38d33 is fetched for user 2ba8718f77974c5aad5aa832a07e697b. {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 08:26:27 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=81,cinder:UPDATE=102,cinder:INSERT=20,cinder:DELETE=7 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:26:27 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:27 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:UPDATE=93,cinder:SELECT=76,cinder:DELETE=11,cinder:INSERT=26 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:26:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c65da72a-538f-4db9-b8c7-5ae2766115f0 tempest-TestStampPattern-1669571982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb" returned: 0 in 0.816s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c65da72a-538f-4db9-b8c7-5ae2766115f0 tempest-TestStampPattern-1669571982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.9262172a-ec05-4227-8bb1-00156835f016 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:27 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cb69ea-436d-44e5-bcb5-67b09706b872]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:26:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_sde2wbfidevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:27 devstack sudo[100799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.9262172a-ec05-4227-8bb1-00156835f016 Nov 03 08:26:27 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:27 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_sde2wbfidevstack@QuobyteHD Nov 03 08:26:27 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:27 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c65da72a-538f-4db9-b8c7-5ae2766115f0 tempest-TestStampPattern-1669571982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.9262172a-ec05-4227-8bb1-00156835f016" returned: 0 in 0.407s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c65da72a-538f-4db9-b8c7-5ae2766115f0 tempest-TestStampPattern-1669571982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.9262172a-ec05-4227-8bb1-00156835f016 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:27 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_sde2wbfidevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:26:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:26:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1035423891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8bcb0ca2055443f1817921e81f500de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:26:25Z,use_quota=True,user_id='2ba8718f77974c5aad5aa832a07e697b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:26:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Creating volume 6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:26:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:26:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:26:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:26:27 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.9262172a-ec05-4227-8bb1-00156835f016 Nov 03 08:26:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:26:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:26:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:26:27 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:27 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:26:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:27 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01 1073741824 Nov 03 08:26:27 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:28 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c65da72a-538f-4db9-b8c7-5ae2766115f0 tempest-TestStampPattern-1669571982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb.9262172a-ec05-4227-8bb1-00156835f016" returned: 0 in 0.343s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:28 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c65da72a-538f-4db9-b8c7-5ae2766115f0 tempest-TestStampPattern-1669571982 None] Lock "cinder-quobyte-9262172a-ec05-4227-8bb1-00156835f016" released by "_delete_snapshot" :: held 2.439s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:26:28 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c65da72a-538f-4db9-b8c7-5ae2766115f0 tempest-TestStampPattern-1669571982 None] Lock "cinder-quobyte-662df0ef-8a4d-4103-a44e-200bd24397fb" released by "delete_snapshot" :: held 2.472s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:26:28 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-c65da72a-538f-4db9-b8c7-5ae2766115f0 tempest-TestStampPattern-1669571982 None] Created reservations ['88a1ff19-71d3-4516-b44c-3c86a1604ffc', 'b72313ee-8e0b-4339-9f43-139aae1852af', '162a2029-ee02-4bcc-995d-43fd06de9e94', 'b2a06d36-a633-44ce-9680-e65e28bd24ca'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:26:28 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-c65da72a-538f-4db9-b8c7-5ae2766115f0 tempest-TestStampPattern-1669571982 None] Delete snapshot completed successfully. Nov 03 08:26:28 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c65da72a-538f-4db9-b8c7-5ae2766115f0 tempest-TestStampPattern-1669571982 None] Lock "cinder-9262172a-ec05-4227-8bb1-00156835f016-delete_snapshot" released by "delete_snapshot" :: held 2.636s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:26:28 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01 1073741824" returned: 0 in 0.581s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:28 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01 Nov 03 08:26:28 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:28 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01" returned: 0 in 0.262s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:26:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:26:28 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Attempting download of 9eb5e936-be4c-46be-8de8-899e9fc38d33 ((None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}])) to volume 6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01. {{(pid=86801) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 08:26:28 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de0eaed-a5f6-4126-b625-5ac4ee554f16]: (4, 'raw') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:26:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_bjzngv2y {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:28 devstack sudo[100825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_bjzngv2y Nov 03 08:26:28 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:29 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_bjzngv2y" returned: 0 in 0.348s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_bjzngv2y {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:29 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_bjzngv2y Nov 03 08:26:29 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:29 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_bjzngv2y" returned: 1 in 0.346s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_bjzngv2y' failed. Not Retrying. {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 08:26:29 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb6a6ac-f503-46af-9602-54f11309272d]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:26:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_sde2wbfidevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:29 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_sde2wbfidevstack@QuobyteHD Nov 03 08:26:29 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:30 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_sde2wbfidevstack@QuobyteHD" returned: 0 in 0.478s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:30 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] 9eb5e936-be4c-46be-8de8-899e9fc38d33 was qcow2, converting to qcow2 {{(pid=86801) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 08:26:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_sde2wbfidevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:30 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_sde2wbfidevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01 Nov 03 08:26:30 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:32 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_sde2wbfidevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01" returned: 0 in 2.530s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:32 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_sde2wbfidevstack@QuobyteHD, size 112.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01 {{(pid=86801) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 08:26:32 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Converted 112.00 MB image at 44.24 MB/s Nov 03 08:26:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:32 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01 1G Nov 03 08:26:32 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:32 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-3bbbd5b4-f6b5-4f06-8440-1081be186904 tempest-TestStampPattern-1669571982 None] Acquiring lock "cinder-662df0ef-8a4d-4103-a44e-200bd24397fb-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:26:32 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-3bbbd5b4-f6b5-4f06-8440-1081be186904 tempest-TestStampPattern-1669571982 None] Lock "cinder-662df0ef-8a4d-4103-a44e-200bd24397fb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:26:32 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-3bbbd5b4-f6b5-4f06-8440-1081be186904 tempest-TestStampPattern-1669571982 None] Acquiring lock "cinder-quobyte-662df0ef-8a4d-4103-a44e-200bd24397fb" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:26:32 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-3bbbd5b4-f6b5-4f06-8440-1081be186904 tempest-TestStampPattern-1669571982 None] Lock "cinder-quobyte-662df0ef-8a4d-4103-a44e-200bd24397fb" acquired by "delete_volume" :: waited 0.033s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:26:32 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4cfe5a-6640-4f23-893e-41f0a147d2de]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:26:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3bbbd5b4-f6b5-4f06-8440-1081be186904 tempest-TestStampPattern-1669571982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:32 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01 1G" returned: 0 in 0.427s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:32 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Downloaded image 9eb5e936-be4c-46be-8de8-899e9fc38d33 ((None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}])) to volume 6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01 successfully. {{(pid=86801) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 08:26:33 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Temporary image 9eb5e936-be4c-46be-8de8-899e9fc38d33 for user 2ba8718f77974c5aad5aa832a07e697b is deleted. {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 08:26:33 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Marking volume 6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01 as bootable. {{(pid=86801) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 08:26:33 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Copying metadata from image 9eb5e936-be4c-46be-8de8-899e9fc38d33 to 6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01. {{(pid=86801) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 08:26:33 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Creating volume glance metadata for volume 6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01 backed by image 9eb5e936-be4c-46be-8de8-899e9fc38d33 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86801) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 08:26:33 devstack sudo[100881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb Nov 03 08:26:33 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa1ad4b-c8d4-4dfe-8d2f-a1743c7a787c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01', 'volume_size': 1, 'image_id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02c779626a284994918db1738b55fe79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'created_at': datetime.datetime(2026, 11, 3, 7, 8, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 8, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9eb5e936-be4c-46be-8de8-899e9fc38d33/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef57fff-205b-4fa0-8459-341c54b52a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:33 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Volume volume-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01 (6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01): created successfully Nov 03 08:26:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef57fff-205b-4fa0-8459-341c54b52a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Flow 'volume_create_manager' (b842adba-db26-498b-87ae-630aa2e399b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:26:33 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-0486b551-f2ab-464b-93ed-1d973db65f0f tempest-VolumesGetTest-1275841772 None] Created volume successfully. Nov 03 08:26:33 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3bbbd5b4-f6b5-4f06-8440-1081be186904 tempest-TestStampPattern-1669571982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb" returned: 0 in 0.398s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3bbbd5b4-f6b5-4f06-8440-1081be186904 tempest-TestStampPattern-1669571982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:33 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb Nov 03 08:26:33 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:33 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3bbbd5b4-f6b5-4f06-8440-1081be186904 tempest-TestStampPattern-1669571982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-662df0ef-8a4d-4103-a44e-200bd24397fb" returned: 0 in 0.256s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-3bbbd5b4-f6b5-4f06-8440-1081be186904 tempest-TestStampPattern-1669571982 None] Lock "cinder-quobyte-662df0ef-8a4d-4103-a44e-200bd24397fb" released by "delete_volume" :: held 0.745s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:26:33 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-3bbbd5b4-f6b5-4f06-8440-1081be186904 tempest-TestStampPattern-1669571982 None] Created reservations ['6954397a-7f56-48d0-b74c-96ac080538d4', '7a09cc23-8dfc-4c37-b688-5356e34929af', 'ea2f2810-e806-455d-be52-f30754912e61', 'a5c702a4-300d-4d76-ae17-e0926a40ab02'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:26:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3bbbd5b4-f6b5-4f06-8440-1081be186904 tempest-TestStampPattern-1669571982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:26:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3bbbd5b4-f6b5-4f06-8440-1081be186904 tempest-TestStampPattern-1669571982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:26:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-3bbbd5b4-f6b5-4f06-8440-1081be186904 tempest-TestStampPattern-1669571982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:26:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-3bbbd5b4-f6b5-4f06-8440-1081be186904 tempest-TestStampPattern-1669571982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:26:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3bbbd5b4-f6b5-4f06-8440-1081be186904 tempest-TestStampPattern-1669571982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:26:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3bbbd5b4-f6b5-4f06-8440-1081be186904 tempest-TestStampPattern-1669571982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:33 devstack sudo[100889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:26:33 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:34 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3bbbd5b4-f6b5-4f06-8440-1081be186904 tempest-TestStampPattern-1669571982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.265s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:34 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-3bbbd5b4-f6b5-4f06-8440-1081be186904 tempest-TestStampPattern-1669571982 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:26:34 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-3bbbd5b4-f6b5-4f06-8440-1081be186904 tempest-TestStampPattern-1669571982 None] Deleted volume successfully. Nov 03 08:26:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-3bbbd5b4-f6b5-4f06-8440-1081be186904 tempest-TestStampPattern-1669571982 None] Lock "cinder-662df0ef-8a4d-4103-a44e-200bd24397fb-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:26:34 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:26:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Flow 'volume_create_manager' (6d1afcb7-46aa-48d8-8391-88916fe4e751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:26:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d82575d-8e21-4416-a35c-a7dbb9ae6e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d82575d-8e21-4416-a35c-a7dbb9ae6e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:26:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-46325796',display_name='tempest-VolumesGetTest-Volume-1858491655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bccfa962-d7b6-4531-a49c-568bba139902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bcb0ca2055443f1817921e81f500de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:26:35Z,use_quota=True,user_id='2ba8718f77974c5aad5aa832a07e697b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1ef9e4f-0276-4606-87cf-413abe75eb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1ef9e4f-0276-4606-87cf-413abe75eb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c15ce94a-8ac9-4543-843f-baffc1ded629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c15ce94a-8ac9-4543-843f-baffc1ded629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bccfa962-d7b6-4531-a49c-568bba139902', 'volume_name': 'volume-bccfa962-d7b6-4531-a49c-568bba139902', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba452e9-6a2a-4c82-833c-9a49fab034e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba452e9-6a2a-4c82-833c-9a49fab034e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:34 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00d0f54b-1fcc-404d-8fbc-edf4d403aefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:34 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Volume bccfa962-d7b6-4531-a49c-568bba139902: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bccfa962-d7b6-4531-a49c-568bba139902', 'volume_size': 1} Nov 03 08:26:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:26:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:26:34 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:26:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-46325796',display_name='tempest-VolumesGetTest-Volume-1858491655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bccfa962-d7b6-4531-a49c-568bba139902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bcb0ca2055443f1817921e81f500de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:26:35Z,use_quota=True,user_id='2ba8718f77974c5aad5aa832a07e697b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:26:34 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Creating volume bccfa962-d7b6-4531-a49c-568bba139902 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:26:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:26:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:26:34 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:26:34 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:26:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:26:34 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:26:34 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:26:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bccfa962-d7b6-4531-a49c-568bba139902 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:35 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bccfa962-d7b6-4531-a49c-568bba139902 1073741824 Nov 03 08:26:35 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:35 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bccfa962-d7b6-4531-a49c-568bba139902 1073741824" returned: 0 in 0.571s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bccfa962-d7b6-4531-a49c-568bba139902 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:35 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bccfa962-d7b6-4531-a49c-568bba139902 Nov 03 08:26:35 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:35 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bccfa962-d7b6-4531-a49c-568bba139902" returned: 0 in 0.297s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:26:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:26:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00d0f54b-1fcc-404d-8fbc-edf4d403aefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bccfa962-d7b6-4531-a49c-568bba139902', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d87dd05-70dd-44ea-a051-79cde2d4f813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:35 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Volume volume-bccfa962-d7b6-4531-a49c-568bba139902 (bccfa962-d7b6-4531-a49c-568bba139902): created successfully Nov 03 08:26:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d87dd05-70dd-44ea-a051-79cde2d4f813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Flow 'volume_create_manager' (6d1afcb7-46aa-48d8-8391-88916fe4e751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:26:35 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-891d4dfe-b326-4d05-9c4b-b8531c726502 tempest-VolumesGetTest-1275841772 None] Created volume successfully. Nov 03 08:26:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-51027dd0-7900-446c-9b1d-ee2da37b1043 tempest-VolumesNegativeTest-1179837335 None] Acquiring lock "cinder-de1d3f95-c486-43e6-ab26-9be640780e65-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:26:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-51027dd0-7900-446c-9b1d-ee2da37b1043 tempest-VolumesNegativeTest-1179837335 None] Lock "cinder-de1d3f95-c486-43e6-ab26-9be640780e65-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:26:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-51027dd0-7900-446c-9b1d-ee2da37b1043 tempest-VolumesNegativeTest-1179837335 None] Acquiring lock "cinder-quobyte-de1d3f95-c486-43e6-ab26-9be640780e65" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:26:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-51027dd0-7900-446c-9b1d-ee2da37b1043 tempest-VolumesNegativeTest-1179837335 None] Lock "cinder-quobyte-de1d3f95-c486-43e6-ab26-9be640780e65" acquired by "delete_volume" :: waited 0.019s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:26:36 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b593b42-9ddd-48d6-adb3-78c706085e60]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:26:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-51027dd0-7900-446c-9b1d-ee2da37b1043 tempest-VolumesNegativeTest-1179837335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-de1d3f95-c486-43e6-ab26-9be640780e65 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:36 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-de1d3f95-c486-43e6-ab26-9be640780e65 Nov 03 08:26:36 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6adcd8dc-50e6-49f8-9202-4040344110ab tempest-VolumesGetTest-1275841772 None] Acquiring lock "cinder-bccfa962-d7b6-4531-a49c-568bba139902-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:26:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6adcd8dc-50e6-49f8-9202-4040344110ab tempest-VolumesGetTest-1275841772 None] Lock "cinder-bccfa962-d7b6-4531-a49c-568bba139902-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:26:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6adcd8dc-50e6-49f8-9202-4040344110ab tempest-VolumesGetTest-1275841772 None] Acquiring lock "cinder-quobyte-bccfa962-d7b6-4531-a49c-568bba139902" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:26:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6adcd8dc-50e6-49f8-9202-4040344110ab tempest-VolumesGetTest-1275841772 None] Lock "cinder-quobyte-bccfa962-d7b6-4531-a49c-568bba139902" acquired by "delete_volume" :: waited 0.017s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:26:37 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[452bde3e-a5d5-4f94-b330-c22d3720ad13]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:26:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6adcd8dc-50e6-49f8-9202-4040344110ab tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bccfa962-d7b6-4531-a49c-568bba139902 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:37 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-51027dd0-7900-446c-9b1d-ee2da37b1043 tempest-VolumesNegativeTest-1179837335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-de1d3f95-c486-43e6-ab26-9be640780e65" returned: 0 in 0.504s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-51027dd0-7900-446c-9b1d-ee2da37b1043 tempest-VolumesNegativeTest-1179837335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-de1d3f95-c486-43e6-ab26-9be640780e65 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:37 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-de1d3f95-c486-43e6-ab26-9be640780e65 Nov 03 08:26:37 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:37 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bccfa962-d7b6-4531-a49c-568bba139902 Nov 03 08:26:37 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:37 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-51027dd0-7900-446c-9b1d-ee2da37b1043 tempest-VolumesNegativeTest-1179837335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-de1d3f95-c486-43e6-ab26-9be640780e65" returned: 0 in 0.260s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-51027dd0-7900-446c-9b1d-ee2da37b1043 tempest-VolumesNegativeTest-1179837335 None] Lock "cinder-quobyte-de1d3f95-c486-43e6-ab26-9be640780e65" released by "delete_volume" :: held 0.812s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:26:37 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-51027dd0-7900-446c-9b1d-ee2da37b1043 tempest-VolumesNegativeTest-1179837335 None] Created reservations ['39121b07-fad5-456b-8ae5-3db6dd520dfa', '6d21e269-e7da-400a-9438-985cc75a04a9', 'd34f4826-18d0-4a85-896b-2a66be9e2511', '7f3d5422-acf4-42d0-b1f2-5c4d9300f263'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:26:37 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6adcd8dc-50e6-49f8-9202-4040344110ab tempest-VolumesGetTest-1275841772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bccfa962-d7b6-4531-a49c-568bba139902" returned: 0 in 0.368s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6adcd8dc-50e6-49f8-9202-4040344110ab tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bccfa962-d7b6-4531-a49c-568bba139902 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:37 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bccfa962-d7b6-4531-a49c-568bba139902 Nov 03 08:26:37 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-51027dd0-7900-446c-9b1d-ee2da37b1043 tempest-VolumesNegativeTest-1179837335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:26:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-51027dd0-7900-446c-9b1d-ee2da37b1043 tempest-VolumesNegativeTest-1179837335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:26:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-51027dd0-7900-446c-9b1d-ee2da37b1043 tempest-VolumesNegativeTest-1179837335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:26:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-51027dd0-7900-446c-9b1d-ee2da37b1043 tempest-VolumesNegativeTest-1179837335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:26:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-51027dd0-7900-446c-9b1d-ee2da37b1043 tempest-VolumesNegativeTest-1179837335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:26:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-51027dd0-7900-446c-9b1d-ee2da37b1043 tempest-VolumesNegativeTest-1179837335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:37 devstack sudo[100918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:26:37 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:37 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6adcd8dc-50e6-49f8-9202-4040344110ab tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bccfa962-d7b6-4531-a49c-568bba139902" returned: 0 in 0.276s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6adcd8dc-50e6-49f8-9202-4040344110ab tempest-VolumesGetTest-1275841772 None] Lock "cinder-quobyte-bccfa962-d7b6-4531-a49c-568bba139902" released by "delete_volume" :: held 0.703s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:26:37 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-51027dd0-7900-446c-9b1d-ee2da37b1043 tempest-VolumesNegativeTest-1179837335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.288s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:38 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-51027dd0-7900-446c-9b1d-ee2da37b1043 tempest-VolumesNegativeTest-1179837335 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:26:38 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-51027dd0-7900-446c-9b1d-ee2da37b1043 tempest-VolumesNegativeTest-1179837335 None] Deleted volume successfully. Nov 03 08:26:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-51027dd0-7900-446c-9b1d-ee2da37b1043 tempest-VolumesNegativeTest-1179837335 None] Lock "cinder-de1d3f95-c486-43e6-ab26-9be640780e65-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:26:38 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-6adcd8dc-50e6-49f8-9202-4040344110ab tempest-VolumesGetTest-1275841772 None] Created reservations ['8bc81f6a-4124-42fa-92c5-df7c8ec8b7a8', '84e738ad-3ea0-4afb-a8c1-9c3fe013296d', 'bbb32d37-9c5c-4b4c-a4c0-7dde4ea4dd49', '5b81795f-ae2f-49f4-99ca-3a0018dcb8e6'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:26:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6adcd8dc-50e6-49f8-9202-4040344110ab tempest-VolumesGetTest-1275841772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:26:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6adcd8dc-50e6-49f8-9202-4040344110ab tempest-VolumesGetTest-1275841772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:26:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6adcd8dc-50e6-49f8-9202-4040344110ab tempest-VolumesGetTest-1275841772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:26:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6adcd8dc-50e6-49f8-9202-4040344110ab tempest-VolumesGetTest-1275841772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:26:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6adcd8dc-50e6-49f8-9202-4040344110ab tempest-VolumesGetTest-1275841772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:26:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6adcd8dc-50e6-49f8-9202-4040344110ab tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:38 devstack sudo[100922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:26:38 devstack sudo[100922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c591c330-195a-41aa-84a4-b2531426327c tempest-VolumesGetTest-1275841772 None] Acquiring lock "cinder-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:26:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c591c330-195a-41aa-84a4-b2531426327c tempest-VolumesGetTest-1275841772 None] Lock "cinder-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:26:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c591c330-195a-41aa-84a4-b2531426327c tempest-VolumesGetTest-1275841772 None] Acquiring lock "cinder-quobyte-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:26:38 devstack sudo[100922]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6adcd8dc-50e6-49f8-9202-4040344110ab tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.477s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:38 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-6adcd8dc-50e6-49f8-9202-4040344110ab tempest-VolumesGetTest-1275841772 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:26:38 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-6adcd8dc-50e6-49f8-9202-4040344110ab tempest-VolumesGetTest-1275841772 None] Deleted volume successfully. Nov 03 08:26:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c591c330-195a-41aa-84a4-b2531426327c tempest-VolumesGetTest-1275841772 None] Lock "cinder-quobyte-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01" acquired by "delete_volume" :: waited 0.044s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:26:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6adcd8dc-50e6-49f8-9202-4040344110ab tempest-VolumesGetTest-1275841772 None] Lock "cinder-bccfa962-d7b6-4531-a49c-568bba139902-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:26:38 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfe6b31-180e-4f3a-81aa-310891219d88]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:26:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c591c330-195a-41aa-84a4-b2531426327c tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:38 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01 Nov 03 08:26:38 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:39 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c591c330-195a-41aa-84a4-b2531426327c tempest-VolumesGetTest-1275841772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01" returned: 0 in 0.405s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c591c330-195a-41aa-84a4-b2531426327c tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:39 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01 Nov 03 08:26:39 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:39 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c591c330-195a-41aa-84a4-b2531426327c tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01" returned: 0 in 0.336s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c591c330-195a-41aa-84a4-b2531426327c tempest-VolumesGetTest-1275841772 None] Lock "cinder-quobyte-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01" released by "delete_volume" :: held 0.824s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:26:39 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-c591c330-195a-41aa-84a4-b2531426327c tempest-VolumesGetTest-1275841772 None] Created reservations ['3b1f284c-a129-42b1-80cd-e7835f11bc7a', '6b276056-3d0c-45b6-a67e-d6b34450d724', '07fa7631-fe16-4ec0-9524-b7617ba6769b', '47d6be70-9fb3-45c9-a007-a324e92df9ec'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:26:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c591c330-195a-41aa-84a4-b2531426327c tempest-VolumesGetTest-1275841772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:26:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c591c330-195a-41aa-84a4-b2531426327c tempest-VolumesGetTest-1275841772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:26:39 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c591c330-195a-41aa-84a4-b2531426327c tempest-VolumesGetTest-1275841772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:26:39 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c591c330-195a-41aa-84a4-b2531426327c tempest-VolumesGetTest-1275841772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:26:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c591c330-195a-41aa-84a4-b2531426327c tempest-VolumesGetTest-1275841772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:26:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c591c330-195a-41aa-84a4-b2531426327c tempest-VolumesGetTest-1275841772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:39 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:26:39 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:39 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c591c330-195a-41aa-84a4-b2531426327c tempest-VolumesGetTest-1275841772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.295s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:40 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-c591c330-195a-41aa-84a4-b2531426327c tempest-VolumesGetTest-1275841772 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:26:40 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-c591c330-195a-41aa-84a4-b2531426327c tempest-VolumesGetTest-1275841772 None] Deleted volume successfully. Nov 03 08:26:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c591c330-195a-41aa-84a4-b2531426327c tempest-VolumesGetTest-1275841772 None] Lock "cinder-6e8a22b0-67ef-491b-9bdb-e5a7e10d6c01-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Flow 'volume_create_manager' (0dae6cb0-dd3b-4b97-bdcd-c1df617be468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8086472c-d366-48cb-a31c-2b039d284ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8086472c-d366-48cb-a31c-2b039d284ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-820442397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3591e80e-b7f4-43f1-b626-b0db9524d5dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed84dccfbba4ebb92a9cfd6436f7c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:26:54Z,use_quota=True,user_id='425d80f26f794fe8beb2ec93fb8902b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de01286-5928-495a-af3e-07d6c262bd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de01286-5928-495a-af3e-07d6c262bd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88299f8b-5a7c-4123-b908-8c509f49a81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88299f8b-5a7c-4123-b908-8c509f49a81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3591e80e-b7f4-43f1-b626-b0db9524d5dc', 'volume_name': 'volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c2e865-4b30-42f0-ba31-d953b99235ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c2e865-4b30-42f0-ba31-d953b99235ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4829506-ebeb-490d-8637-32f88e8786fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:54 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Volume 3591e80e-b7f4-43f1-b626-b0db9524d5dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc', 'volume_size': 1} Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-820442397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3591e80e-b7f4-43f1-b626-b0db9524d5dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed84dccfbba4ebb92a9cfd6436f7c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:26:54Z,use_quota=True,user_id='425d80f26f794fe8beb2ec93fb8902b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Creating volume 3591e80e-b7f4-43f1-b626-b0db9524d5dc {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:26:54 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:54 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc 1073741824 Nov 03 08:26:54 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Flow 'volume_create_manager' (4f1c8b45-3ebb-4ead-9dec-a6603920edc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6f4fbf6-7541-4599-a50e-3027df216805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6f4fbf6-7541-4599-a50e-3027df216805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbe6906a-8520-4bf1-b4bd-4db66ae9741c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08f9667d9534825a61930aa0604494c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:26:55Z,use_quota=True,user_id='7650e6fe948148538b5f05943b36e476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30eba2f0-f609-41cf-890c-f5fabe3e9810),volume_type_id=30eba2f0-f609-41cf-890c-f5fabe3e9810)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d31b9e2-2ddb-427f-824d-39c3c320febb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d31b9e2-2ddb-427f-824d-39c3c320febb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22c8ebe8-adee-444f-a174-916d11bf8d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:54 devstack cinder-volume[86801]: DEBUG cinder.image.glance [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Creating Keystone auth plugin from conf {{(pid=86801) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 08:26:55 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc 1073741824" returned: 0 in 0.585s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:55 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22c8ebe8-adee-444f-a174-916d11bf8d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cbe6906a-8520-4bf1-b4bd-4db66ae9741c', 'volume_name': 'volume-cbe6906a-8520-4bf1-b4bd-4db66ae9741c', 'volume_size': 1, 'image_id': 'ea0714a3-764a-4c87-a2dd-9d1a4a51d13b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea0714a3-764a-4c87-a2dd-9d1a4a51d13b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '012c665b56eff6ca51b9f05ad0da4620', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd08f9667d9534825a61930aa0604494c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0a8290611dde4c79bcf66df01440320751f98c2da3f805b2d0fcb71df1218f9ad6f7b857dcecbc20a8c40e38526a37f8526d265441ab113faa80fd052c6f553d', 'id': 'ea0714a3-764a-4c87-a2dd-9d1a4a51d13b', 'created_at': datetime.datetime(2026, 11, 3, 7, 26, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 26, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea0714a3-764a-4c87-a2dd-9d1a4a51d13b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:55 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2897a491-5773-412a-86e3-ca7e69596a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:55 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2897a491-5773-412a-86e3-ca7e69596a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:55 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859da0c8-3c08-4626-acd2-870592c27267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:55 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Volume cbe6906a-8520-4bf1-b4bd-4db66ae9741c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cbe6906a-8520-4bf1-b4bd-4db66ae9741c', 'volume_size': 1, 'image_id': 'ea0714a3-764a-4c87-a2dd-9d1a4a51d13b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea0714a3-764a-4c87-a2dd-9d1a4a51d13b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '012c665b56eff6ca51b9f05ad0da4620', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd08f9667d9534825a61930aa0604494c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0a8290611dde4c79bcf66df01440320751f98c2da3f805b2d0fcb71df1218f9ad6f7b857dcecbc20a8c40e38526a37f8526d265441ab113faa80fd052c6f553d', 'id': 'ea0714a3-764a-4c87-a2dd-9d1a4a51d13b', 'created_at': datetime.datetime(2026, 11, 3, 7, 26, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 26, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea0714a3-764a-4c87-a2dd-9d1a4a51d13b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 03 08:26:55 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Trying to clone cbe6906a-8520-4bf1-b4bd-4db66ae9741c from image ea0714a3-764a-4c87-a2dd-9d1a4a51d13b at location (None, [{'url': 'file:///opt/stack/data/glance/images/ea0714a3-764a-4c87-a2dd-9d1a4a51d13b', 'metadata': {}}]). {{(pid=86801) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 08:26:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:55 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc Nov 03 08:26:55 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:55 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_j__f5f3udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 08:26:55 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Image download 0.00 MB at 0.00 MB/s Nov 03 08:26:55 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dc6f96-2da4-4fd4-863e-e58d84867573]: (4, 'raw') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:26:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_j__f5f3udevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:55 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:55 devstack sudo[100953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_j__f5f3udevstack@QuobyteHD Nov 03 08:26:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc" returned: 0 in 0.442s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:55 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:26:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:26:55 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:55 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4829506-ebeb-490d-8637-32f88e8786fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:55 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef9d755-16e7-40cd-8945-131b617da074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:26:55 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Volume volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc (3591e80e-b7f4-43f1-b626-b0db9524d5dc): created successfully Nov 03 08:26:55 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef9d755-16e7-40cd-8945-131b617da074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:26:55 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Flow 'volume_create_manager' (0dae6cb0-dd3b-4b97-bdcd-c1df617be468) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:26:55 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-b5794551-943f-4bc5-a2d3-297a97745bed tempest-VolumesSnapshotTestJSON-571293391 None] Created volume successfully. Nov 03 08:26:55 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_j__f5f3udevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_j__f5f3udevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:55 devstack sudo[100958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_j__f5f3udevstack@QuobyteHD Nov 03 08:26:55 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:56 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_j__f5f3udevstack@QuobyteHD" returned: 1 in 0.357s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_j__f5f3udevstack@QuobyteHD' failed. Not Retrying. {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 08:26:56 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Temporary image ea0714a3-764a-4c87-a2dd-9d1a4a51d13b is fetched for user 7650e6fe948148538b5f05943b36e476. {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 08:26:56 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[360addbc-c481-44cc-b8b1-8a42a69aa149]: (4, 'raw') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:26:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_j__f5f3udevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:56 devstack sudo[100964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_j__f5f3udevstack@QuobyteHD Nov 03 08:26:56 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:56 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_j__f5f3udevstack@QuobyteHD" returned: 0 in 0.458s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_j__f5f3udevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:56 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_j__f5f3udevstack@QuobyteHD Nov 03 08:26:56 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-01cfeea1-2a93-4c18-bd95-2bcdc0628dd4 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:26:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-01cfeea1-2a93-4c18-bd95-2bcdc0628dd4 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:26:56 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-01cfeea1-2a93-4c18-bd95-2bcdc0628dd4 tempest-VolumesSnapshotTestJSON-571293391 None] Creating offline snapshot a330912c-cb4a-409b-b37b-28e14d7c34f9 of volume 3591e80e-b7f4-43f1-b626-b0db9524d5dc {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:26:56 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31d1588-b0e8-43f8-8a04-c84273ebea96]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:26:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-01cfeea1-2a93-4c18-bd95-2bcdc0628dd4 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:57 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc Nov 03 08:26:57 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:57 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_j__f5f3udevstack@QuobyteHD" returned: 1 in 0.441s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_j__f5f3udevstack@QuobyteHD' failed. Not Retrying. {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 08:26:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:26:57 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-01cfeea1-2a93-4c18-bd95-2bcdc0628dd4 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc" returned: 0 in 0.426s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-01cfeea1-2a93-4c18-bd95-2bcdc0628dd4 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc.a330912c-cb4a-409b-b37b-28e14d7c34f9 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:57 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc.a330912c-cb4a-409b-b37b-28e14d7c34f9 1G Nov 03 08:26:57 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:57 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-01cfeea1-2a93-4c18-bd95-2bcdc0628dd4 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc.a330912c-cb4a-409b-b37b-28e14d7c34f9 1G" returned: 0 in 0.484s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-01cfeea1-2a93-4c18-bd95-2bcdc0628dd4 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc.a330912c-cb4a-409b-b37b-28e14d7c34f9 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:57 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc.a330912c-cb4a-409b-b37b-28e14d7c34f9 Nov 03 08:26:57 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:58 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-01cfeea1-2a93-4c18-bd95-2bcdc0628dd4 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc.a330912c-cb4a-409b-b37b-28e14d7c34f9" returned: 0 in 0.327s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:58 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-01cfeea1-2a93-4c18-bd95-2bcdc0628dd4 tempest-VolumesSnapshotTestJSON-571293391 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc.a330912c-cb4a-409b-b37b-28e14d7c34f9 is being set with open permissions: ugo+rw Nov 03 08:26:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-01cfeea1-2a93-4c18-bd95-2bcdc0628dd4 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc.a330912c-cb4a-409b-b37b-28e14d7c34f9 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:58 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc.a330912c-cb4a-409b-b37b-28e14d7c34f9 Nov 03 08:26:58 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:58 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-01cfeea1-2a93-4c18-bd95-2bcdc0628dd4 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc.a330912c-cb4a-409b-b37b-28e14d7c34f9" returned: 0 in 0.273s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-01cfeea1-2a93-4c18-bd95-2bcdc0628dd4 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:58 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc.info Nov 03 08:26:58 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:58 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-01cfeea1-2a93-4c18-bd95-2bcdc0628dd4 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc.info" returned: 0 in 0.259s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:58 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-01cfeea1-2a93-4c18-bd95-2bcdc0628dd4 tempest-VolumesSnapshotTestJSON-571293391 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc.info is being set with open permissions: ugo+rw Nov 03 08:26:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-01cfeea1-2a93-4c18-bd95-2bcdc0628dd4 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:58 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc.info Nov 03 08:26:58 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:59 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-01cfeea1-2a93-4c18-bd95-2bcdc0628dd4 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc.info" returned: 0 in 0.266s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-01cfeea1-2a93-4c18-bd95-2bcdc0628dd4 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.148s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:26:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.910s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:26:59 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbe6906a-8520-4bf1-b4bd-4db66ae9741c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08f9667d9534825a61930aa0604494c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:26:55Z,use_quota=True,user_id='7650e6fe948148538b5f05943b36e476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30eba2f0-f609-41cf-890c-f5fabe3e9810),volume_type_id=30eba2f0-f609-41cf-890c-f5fabe3e9810)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:26:59 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Creating volume cbe6906a-8520-4bf1-b4bd-4db66ae9741c {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:26:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:26:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:26:59 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:26:59 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:26:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:26:59 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:26:59 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:26:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cbe6906a-8520-4bf1-b4bd-4db66ae9741c 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:59 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cbe6906a-8520-4bf1-b4bd-4db66ae9741c 1073741824 Nov 03 08:26:59 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:59 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-01cfeea1-2a93-4c18-bd95-2bcdc0628dd4 tempest-VolumesSnapshotTestJSON-571293391 None] Create snapshot completed successfully Nov 03 08:26:59 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cbe6906a-8520-4bf1-b4bd-4db66ae9741c 1073741824" returned: 0 in 0.485s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cbe6906a-8520-4bf1-b4bd-4db66ae9741c {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:26:59 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cbe6906a-8520-4bf1-b4bd-4db66ae9741c Nov 03 08:26:59 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:26:59 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Nov 03 08:26:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cbe6906a-8520-4bf1-b4bd-4db66ae9741c" returned: 0 in 0.254s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:26:59 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:26:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:26:59 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Attempting download of ea0714a3-764a-4c87-a2dd-9d1a4a51d13b ((None, [{'url': 'file:///opt/stack/data/glance/images/ea0714a3-764a-4c87-a2dd-9d1a4a51d13b', 'metadata': {}}])) to volume cbe6906a-8520-4bf1-b4bd-4db66ae9741c. {{(pid=86801) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 08:26:59 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b827d05-a12a-4e95-a2b2-36caa5f82c94]: (4, 'raw') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:26:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_0bl986pq {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:00 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_0bl986pq Nov 03 08:27:00 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:00 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-062b6884-8088-4a54-a3f8-435f5ca5a294 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "cinder-a330912c-cb4a-409b-b37b-28e14d7c34f9-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:00 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-062b6884-8088-4a54-a3f8-435f5ca5a294 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-a330912c-cb4a-409b-b37b-28e14d7c34f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:00 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-062b6884-8088-4a54-a3f8-435f5ca5a294 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "cinder-quobyte-3591e80e-b7f4-43f1-b626-b0db9524d5dc" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:00 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-062b6884-8088-4a54-a3f8-435f5ca5a294 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-3591e80e-b7f4-43f1-b626-b0db9524d5dc" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:00 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-062b6884-8088-4a54-a3f8-435f5ca5a294 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "cinder-quobyte-a330912c-cb4a-409b-b37b-28e14d7c34f9" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:00 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-062b6884-8088-4a54-a3f8-435f5ca5a294 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-a330912c-cb4a-409b-b37b-28e14d7c34f9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-062b6884-8088-4a54-a3f8-435f5ca5a294 tempest-VolumesSnapshotTestJSON-571293391 None] Deleting offline snapshot a330912c-cb4a-409b-b37b-28e14d7c34f9 of volume 3591e80e-b7f4-43f1-b626-b0db9524d5dc {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:27:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-062b6884-8088-4a54-a3f8-435f5ca5a294 tempest-VolumesSnapshotTestJSON-571293391 None] snapshot_file for this snap is: volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc.a330912c-cb4a-409b-b37b-28e14d7c34f9 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:27:00 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_0bl986pq" returned: 0 in 0.397s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_0bl986pq {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:00 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbe6e91-d23f-4ada-89eb-14ef7a184be8]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-062b6884-8088-4a54-a3f8-435f5ca5a294 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc.a330912c-cb4a-409b-b37b-28e14d7c34f9 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:00 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_0bl986pq Nov 03 08:27:00 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:00 devstack sudo[101015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc.a330912c-cb4a-409b-b37b-28e14d7c34f9 Nov 03 08:27:00 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:00 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_0bl986pq" returned: 1 in 0.369s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_0bl986pq' failed. Not Retrying. {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 08:27:00 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36a554a-b841-41c8-8cc5-0273a76c95bb]: (4, 'raw') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_j__f5f3udevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:00 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-062b6884-8088-4a54-a3f8-435f5ca5a294 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc.a330912c-cb4a-409b-b37b-28e14d7c34f9" returned: 0 in 0.421s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-062b6884-8088-4a54-a3f8-435f5ca5a294 tempest-VolumesSnapshotTestJSON-571293391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:27:00 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d47614c-1f13-455e-9d2f-becbf04eac76]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-062b6884-8088-4a54-a3f8-435f5ca5a294 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:00 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_j__f5f3udevstack@QuobyteHD Nov 03 08:27:00 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:00 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc Nov 03 08:27:00 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:01 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_j__f5f3udevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_j__f5f3udevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:01 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_j__f5f3udevstack@QuobyteHD Nov 03 08:27:01 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:01 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-062b6884-8088-4a54-a3f8-435f5ca5a294 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc" returned: 0 in 0.393s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-062b6884-8088-4a54-a3f8-435f5ca5a294 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc.a330912c-cb4a-409b-b37b-28e14d7c34f9 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:01 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc.a330912c-cb4a-409b-b37b-28e14d7c34f9 Nov 03 08:27:01 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:01 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_j__f5f3udevstack@QuobyteHD" returned: 1 in 0.369s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_j__f5f3udevstack@QuobyteHD' failed. Not Retrying. {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 08:27:01 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] ea0714a3-764a-4c87-a2dd-9d1a4a51d13b was raw, converting to qcow2 {{(pid=86801) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 08:27:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_j__f5f3udevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cbe6906a-8520-4bf1-b4bd-4db66ae9741c {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:01 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_j__f5f3udevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cbe6906a-8520-4bf1-b4bd-4db66ae9741c Nov 03 08:27:01 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:01 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-062b6884-8088-4a54-a3f8-435f5ca5a294 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc.a330912c-cb4a-409b-b37b-28e14d7c34f9" returned: 0 in 0.376s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-062b6884-8088-4a54-a3f8-435f5ca5a294 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc.a330912c-cb4a-409b-b37b-28e14d7c34f9 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:01 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc.a330912c-cb4a-409b-b37b-28e14d7c34f9 Nov 03 08:27:01 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:01 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-062b6884-8088-4a54-a3f8-435f5ca5a294 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc.a330912c-cb4a-409b-b37b-28e14d7c34f9" returned: 0 in 0.264s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-062b6884-8088-4a54-a3f8-435f5ca5a294 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-a330912c-cb4a-409b-b37b-28e14d7c34f9" released by "_delete_snapshot" :: held 1.635s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-062b6884-8088-4a54-a3f8-435f5ca5a294 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-3591e80e-b7f4-43f1-b626-b0db9524d5dc" released by "delete_snapshot" :: held 1.665s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:01 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_j__f5f3udevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cbe6906a-8520-4bf1-b4bd-4db66ae9741c" returned: 0 in 0.506s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:02 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ea0714a3-764a-4c87-a2dd-9d1a4a51d13b_j__f5f3udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cbe6906a-8520-4bf1-b4bd-4db66ae9741c {{(pid=86801) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 08:27:02 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 08:27:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cbe6906a-8520-4bf1-b4bd-4db66ae9741c 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:02 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cbe6906a-8520-4bf1-b4bd-4db66ae9741c 1G Nov 03 08:27:02 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:02 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-062b6884-8088-4a54-a3f8-435f5ca5a294 tempest-VolumesSnapshotTestJSON-571293391 None] Created reservations ['fe22da00-15b0-4dfd-9a34-e64b954d56a0', 'fea70874-6578-4658-8750-97a3a232542d', '577db2ea-4efc-4a46-b949-0eb70d221916', '7b331f2f-d4ea-44f8-b331-9c74d91c5674'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:27:02 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-062b6884-8088-4a54-a3f8-435f5ca5a294 tempest-VolumesSnapshotTestJSON-571293391 None] Delete snapshot completed successfully. Nov 03 08:27:02 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-062b6884-8088-4a54-a3f8-435f5ca5a294 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-a330912c-cb4a-409b-b37b-28e14d7c34f9-delete_snapshot" released by "delete_snapshot" :: held 1.872s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:02 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cbe6906a-8520-4bf1-b4bd-4db66ae9741c 1G" returned: 0 in 0.361s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:02 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Downloaded image ea0714a3-764a-4c87-a2dd-9d1a4a51d13b ((None, [{'url': 'file:///opt/stack/data/glance/images/ea0714a3-764a-4c87-a2dd-9d1a4a51d13b', 'metadata': {}}])) to volume cbe6906a-8520-4bf1-b4bd-4db66ae9741c successfully. {{(pid=86801) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 08:27:02 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Temporary image ea0714a3-764a-4c87-a2dd-9d1a4a51d13b for user 7650e6fe948148538b5f05943b36e476 is deleted. {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 08:27:02 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Marking volume cbe6906a-8520-4bf1-b4bd-4db66ae9741c as bootable. {{(pid=86801) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 08:27:02 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Copying metadata from image ea0714a3-764a-4c87-a2dd-9d1a4a51d13b to cbe6906a-8520-4bf1-b4bd-4db66ae9741c. {{(pid=86801) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 08:27:02 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Creating volume glance metadata for volume cbe6906a-8520-4bf1-b4bd-4db66ae9741c backed by image ea0714a3-764a-4c87-a2dd-9d1a4a51d13b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ea0714a3-764a-4c87-a2dd-9d1a4a51d13b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '012c665b56eff6ca51b9f05ad0da4620', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86801) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 08:27:02 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859da0c8-3c08-4626-acd2-870592c27267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbe6906a-8520-4bf1-b4bd-4db66ae9741c', 'volume_size': 1, 'image_id': 'ea0714a3-764a-4c87-a2dd-9d1a4a51d13b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea0714a3-764a-4c87-a2dd-9d1a4a51d13b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '012c665b56eff6ca51b9f05ad0da4620', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd08f9667d9534825a61930aa0604494c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0a8290611dde4c79bcf66df01440320751f98c2da3f805b2d0fcb71df1218f9ad6f7b857dcecbc20a8c40e38526a37f8526d265441ab113faa80fd052c6f553d', 'id': 'ea0714a3-764a-4c87-a2dd-9d1a4a51d13b', 'created_at': datetime.datetime(2026, 11, 3, 7, 26, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 26, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea0714a3-764a-4c87-a2dd-9d1a4a51d13b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:02 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (634647c7-f256-4af6-b375-6456ce7c4633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:02 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Volume volume-cbe6906a-8520-4bf1-b4bd-4db66ae9741c (cbe6906a-8520-4bf1-b4bd-4db66ae9741c): created successfully Nov 03 08:27:02 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (634647c7-f256-4af6-b375-6456ce7c4633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:02 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Flow 'volume_create_manager' (4f1c8b45-3ebb-4ead-9dec-a6603920edc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:27:02 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-988e373a-c4a6-4cc7-af70-203198c8eaa8 tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Created volume successfully. Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Flow 'volume_create_manager' (a247e038-be7e-4c23-8338-cb9dc3a5b141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba38c35-ac0d-4243-a744-399eb6be7805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba38c35-ac0d-4243-a744-399eb6be7805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-462323921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0acaaa76-e65f-4ff2-88ec-823526ef4683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed84dccfbba4ebb92a9cfd6436f7c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:27:03Z,use_quota=True,user_id='425d80f26f794fe8beb2ec93fb8902b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a8d948-ff04-4d37-89e1-ef6a9b0ce11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a8d948-ff04-4d37-89e1-ef6a9b0ce11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4a09fc-d2cb-4445-a660-f31829b8df71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4a09fc-d2cb-4445-a660-f31829b8df71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0acaaa76-e65f-4ff2-88ec-823526ef4683', 'volume_name': 'volume-0acaaa76-e65f-4ff2-88ec-823526ef4683', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae3d630d-e7e4-4c2f-877a-88a2cf188e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae3d630d-e7e4-4c2f-877a-88a2cf188e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb59d11-7427-42bf-a56c-cf446c5c09c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:03 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Volume 0acaaa76-e65f-4ff2-88ec-823526ef4683: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0acaaa76-e65f-4ff2-88ec-823526ef4683', 'volume_size': 1} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-462323921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0acaaa76-e65f-4ff2-88ec-823526ef4683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed84dccfbba4ebb92a9cfd6436f7c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:27:03Z,use_quota=True,user_id='425d80f26f794fe8beb2ec93fb8902b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Creating volume 0acaaa76-e65f-4ff2-88ec-823526ef4683 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:27:03 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-85c8e0e5-86d2-472e-aa88-50ff169625bf tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Acquiring lock "cinder-cbe6906a-8520-4bf1-b4bd-4db66ae9741c-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:03 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683 1073741824 Nov 03 08:27:03 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-85c8e0e5-86d2-472e-aa88-50ff169625bf tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Lock "cinder-cbe6906a-8520-4bf1-b4bd-4db66ae9741c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-85c8e0e5-86d2-472e-aa88-50ff169625bf tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Acquiring lock "cinder-quobyte-cbe6906a-8520-4bf1-b4bd-4db66ae9741c" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-85c8e0e5-86d2-472e-aa88-50ff169625bf tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Lock "cinder-quobyte-cbe6906a-8520-4bf1-b4bd-4db66ae9741c" acquired by "delete_volume" :: waited 0.032s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92fc20a-637c-4aeb-8447-316b134570ad]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-85c8e0e5-86d2-472e-aa88-50ff169625bf tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cbe6906a-8520-4bf1-b4bd-4db66ae9741c {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:03 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cbe6906a-8520-4bf1-b4bd-4db66ae9741c Nov 03 08:27:03 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:03 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683 1073741824" returned: 0 in 0.573s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:03 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:27:03 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:03 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-85c8e0e5-86d2-472e-aa88-50ff169625bf tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cbe6906a-8520-4bf1-b4bd-4db66ae9741c" returned: 0 in 0.505s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-85c8e0e5-86d2-472e-aa88-50ff169625bf tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cbe6906a-8520-4bf1-b4bd-4db66ae9741c {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:03 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683 Nov 03 08:27:03 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:03 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cbe6906a-8520-4bf1-b4bd-4db66ae9741c Nov 03 08:27:03 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:04 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.430s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:04 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:27:04 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager._thread_info {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:27:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread count: 29 {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 08:27:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread info: [<_MainThread(MainThread, started 139707544170624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 08:27:04 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-85c8e0e5-86d2-472e-aa88-50ff169625bf tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cbe6906a-8520-4bf1-b4bd-4db66ae9741c" returned: 0 in 0.376s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-85c8e0e5-86d2-472e-aa88-50ff169625bf tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Lock "cinder-quobyte-cbe6906a-8520-4bf1-b4bd-4db66ae9741c" released by "delete_volume" :: held 0.940s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:04 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:04 devstack cinder-volume[86801]: WARNING cinder.quota [None req-85c8e0e5-86d2-472e-aa88-50ff169625bf tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:27:04 devstack cinder-volume[86801]: WARNING cinder.quota [None req-85c8e0e5-86d2-472e-aa88-50ff169625bf tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:27:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683" returned: 0 in 0.457s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:27:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb59d11-7427-42bf-a56c-cf446c5c09c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0acaaa76-e65f-4ff2-88ec-823526ef4683', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db6d9199-b71b-491c-aae2-c950ca8fa66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:04 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Volume volume-0acaaa76-e65f-4ff2-88ec-823526ef4683 (0acaaa76-e65f-4ff2-88ec-823526ef4683): created successfully Nov 03 08:27:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db6d9199-b71b-491c-aae2-c950ca8fa66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Flow 'volume_create_manager' (a247e038-be7e-4c23-8338-cb9dc3a5b141) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:27:04 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-85c8e0e5-86d2-472e-aa88-50ff169625bf tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Created reservations ['7c9b797b-50bc-4acb-84c7-37288d765004', '24177d6b-f446-4fc2-8c5b-d2489e61fd50', '19f12f36-72a7-4382-9628-438d00d30611', '15c7f8f2-0466-4d28-9830-38def94b0056'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:27:04 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-f973df2b-a288-4b27-a91b-2dcdcdb4af65 tempest-VolumesSnapshotTestJSON-571293391 None] Created volume successfully. Nov 03 08:27:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-85c8e0e5-86d2-472e-aa88-50ff169625bf tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-85c8e0e5-86d2-472e-aa88-50ff169625bf tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-85c8e0e5-86d2-472e-aa88-50ff169625bf tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-85c8e0e5-86d2-472e-aa88-50ff169625bf tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-85c8e0e5-86d2-472e-aa88-50ff169625bf tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-85c8e0e5-86d2-472e-aa88-50ff169625bf tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:04 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:27:04 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:04 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-85c8e0e5-86d2-472e-aa88-50ff169625bf tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.311s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:04 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-85c8e0e5-86d2-472e-aa88-50ff169625bf tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:27:04 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-85c8e0e5-86d2-472e-aa88-50ff169625bf tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Deleted volume successfully. Nov 03 08:27:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-85c8e0e5-86d2-472e-aa88-50ff169625bf tempest-VolumeAndVolumeTypeFromImageTest-634546926 None] Lock "cinder-cbe6906a-8520-4bf1-b4bd-4db66ae9741c-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-67b3d360-9b4a-425f-bfde-5e99937db38e tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-67b3d360-9b4a-425f-bfde-5e99937db38e tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:05 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-67b3d360-9b4a-425f-bfde-5e99937db38e tempest-VolumesSnapshotTestJSON-571293391 None] Creating offline snapshot e3d10c2d-b2be-4a71-99b1-2870e987ce35 of volume 0acaaa76-e65f-4ff2-88ec-823526ef4683 {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:27:05 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8612846-cea6-4844-94e4-022fb0de127f]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-67b3d360-9b4a-425f-bfde-5e99937db38e tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:05 devstack sudo[101087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683 Nov 03 08:27:05 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:05 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-67b3d360-9b4a-425f-bfde-5e99937db38e tempest-VolumesSnapshotTestJSON-571293391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683" returned: 0 in 0.502s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-67b3d360-9b4a-425f-bfde-5e99937db38e tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.e3d10c2d-b2be-4a71-99b1-2870e987ce35 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:05 devstack sudo[101092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.e3d10c2d-b2be-4a71-99b1-2870e987ce35 1G Nov 03 08:27:05 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:06 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-67b3d360-9b4a-425f-bfde-5e99937db38e tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.e3d10c2d-b2be-4a71-99b1-2870e987ce35 1G" returned: 0 in 0.518s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-67b3d360-9b4a-425f-bfde-5e99937db38e tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0acaaa76-e65f-4ff2-88ec-823526ef4683 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.e3d10c2d-b2be-4a71-99b1-2870e987ce35 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:06 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0acaaa76-e65f-4ff2-88ec-823526ef4683 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.e3d10c2d-b2be-4a71-99b1-2870e987ce35 Nov 03 08:27:06 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:06 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-67b3d360-9b4a-425f-bfde-5e99937db38e tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0acaaa76-e65f-4ff2-88ec-823526ef4683 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.e3d10c2d-b2be-4a71-99b1-2870e987ce35" returned: 0 in 0.346s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:06 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-67b3d360-9b4a-425f-bfde-5e99937db38e tempest-VolumesSnapshotTestJSON-571293391 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.e3d10c2d-b2be-4a71-99b1-2870e987ce35 is being set with open permissions: ugo+rw Nov 03 08:27:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-67b3d360-9b4a-425f-bfde-5e99937db38e tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.e3d10c2d-b2be-4a71-99b1-2870e987ce35 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:06 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.e3d10c2d-b2be-4a71-99b1-2870e987ce35 Nov 03 08:27:06 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:07 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-67b3d360-9b4a-425f-bfde-5e99937db38e tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.e3d10c2d-b2be-4a71-99b1-2870e987ce35" returned: 0 in 0.315s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-67b3d360-9b4a-425f-bfde-5e99937db38e tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:07 devstack sudo[101108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.info Nov 03 08:27:07 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:07 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-67b3d360-9b4a-425f-bfde-5e99937db38e tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.info" returned: 0 in 0.394s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:07 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-67b3d360-9b4a-425f-bfde-5e99937db38e tempest-VolumesSnapshotTestJSON-571293391 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.info is being set with open permissions: ugo+rw Nov 03 08:27:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-67b3d360-9b4a-425f-bfde-5e99937db38e tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:07 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.info Nov 03 08:27:07 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:07 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-67b3d360-9b4a-425f-bfde-5e99937db38e tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.info" returned: 0 in 0.393s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-67b3d360-9b4a-425f-bfde-5e99937db38e tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.613s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:07 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-67b3d360-9b4a-425f-bfde-5e99937db38e tempest-VolumesSnapshotTestJSON-571293391 None] Create snapshot completed successfully Nov 03 08:27:08 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:27:08 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Flow 'volume_create_manager' (cbb01fa7-287b-402c-9bdc-6853958afc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:27:08 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ef08ce-7d3a-4092-ad2f-d7e5b8a4411e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ef08ce-7d3a-4092-ad2f-d7e5b8a4411e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1413342710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6d80a26-0d37-439b-9f89-d2dd4e401da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230e216f22c1415da9a2c28b8e96d226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:27:09Z,use_quota=True,user_id='74c8472a3b54445f8452cb2304f12d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb8c69c-7b14-4980-b6df-f7a484ef9405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb8c69c-7b14-4980-b6df-f7a484ef9405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8464f8b-37fd-4f5f-8513-d3f763d5bd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8464f8b-37fd-4f5f-8513-d3f763d5bd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6d80a26-0d37-439b-9f89-d2dd4e401da6', 'volume_name': 'volume-e6d80a26-0d37-439b-9f89-d2dd4e401da6', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f9fbef-9062-43c5-bfff-26f52b5b1c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f9fbef-9062-43c5-bfff-26f52b5b1c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0175142f-723f-4121-9376-630179878fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:09 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Volume e6d80a26-0d37-439b-9f89-d2dd4e401da6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6d80a26-0d37-439b-9f89-d2dd4e401da6', 'volume_size': 1} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1413342710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6d80a26-0d37-439b-9f89-d2dd4e401da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230e216f22c1415da9a2c28b8e96d226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:27:09Z,use_quota=True,user_id='74c8472a3b54445f8452cb2304f12d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Creating volume e6d80a26-0d37-439b-9f89-d2dd4e401da6 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:27:09 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e6d80a26-0d37-439b-9f89-d2dd4e401da6 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:09 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e6d80a26-0d37-439b-9f89-d2dd4e401da6 1073741824 Nov 03 08:27:09 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Flow 'volume_create_manager' (cd3a4227-745e-4855-9875-f6b88d48e714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b430324c-b6d1-4910-a21b-ee548cd4986a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b430324c-b6d1-4910-a21b-ee548cd4986a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1127673622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5794c9b3-b874-437b-8bd3-a89780ffcc40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed84dccfbba4ebb92a9cfd6436f7c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:27:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e3d10c2d-b2be-4a71-99b1-2870e987ce35,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:27:09Z,use_quota=True,user_id='425d80f26f794fe8beb2ec93fb8902b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1a02f7c-7db6-47bd-96ce-f3f9ad19ed7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1a02f7c-7db6-47bd-96ce-f3f9ad19ed7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (992d80bd-12eb-47ff-b7c9-2f4db7aa3283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (992d80bd-12eb-47ff-b7c9-2f4db7aa3283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5794c9b3-b874-437b-8bd3-a89780ffcc40', 'volume_name': 'volume-5794c9b3-b874-437b-8bd3-a89780ffcc40', 'volume_size': 2, 'snapshot_id': 'e3d10c2d-b2be-4a71-99b1-2870e987ce35'}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (364e0cc1-f321-45ef-a3d7-3862912fdbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (364e0cc1-f321-45ef-a3d7-3862912fdbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb16dc2-22a1-48e3-8d81-926c5fabfc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:09 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Volume 5794c9b3-b874-437b-8bd3-a89780ffcc40: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5794c9b3-b874-437b-8bd3-a89780ffcc40', 'volume_size': 2, 'snapshot_id': 'e3d10c2d-b2be-4a71-99b1-2870e987ce35'} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Flow 'volume_create_manager' (99d6671d-5cab-4e84-8171-deeb4be1b8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f49ec00-54c9-4d6b-87fe-7ee6cd873f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f49ec00-54c9-4d6b-87fe-7ee6cd873f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-658318273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acb50b83-119b-4030-8d10-ff4796fa8ce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230e216f22c1415da9a2c28b8e96d226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:27:09Z,use_quota=True,user_id='74c8472a3b54445f8452cb2304f12d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38add3c-e7b6-45c1-bd3e-1327654c5951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38add3c-e7b6-45c1-bd3e-1327654c5951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a9cfddb-087d-4c18-9fe3-51d8e9e16bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a9cfddb-087d-4c18-9fe3-51d8e9e16bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acb50b83-119b-4030-8d10-ff4796fa8ce5', 'volume_name': 'volume-acb50b83-119b-4030-8d10-ff4796fa8ce5', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9535f26c-2f2f-4fde-b392-6f1932e45751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9535f26c-2f2f-4fde-b392-6f1932e45751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd280d2f-56c9-425b-8ab7-5bf7e83697c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:09 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Volume acb50b83-119b-4030-8d10-ff4796fa8ce5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acb50b83-119b-4030-8d10-ff4796fa8ce5', 'volume_size': 1} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:09 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e6d80a26-0d37-439b-9f89-d2dd4e401da6 1073741824" returned: 0 in 0.580s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e6d80a26-0d37-439b-9f89-d2dd4e401da6 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:09 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e6d80a26-0d37-439b-9f89-d2dd4e401da6 Nov 03 08:27:09 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:09 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e6d80a26-0d37-439b-9f89-d2dd4e401da6" returned: 0 in 0.281s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.479s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:09 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "cinder-quobyte-e3d10c2d-b2be-4a71-99b1-2870e987ce35-5794c9b3-b874-437b-8bd3-a89780ffcc40" by "_create_volume_from_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:10 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0175142f-723f-4121-9376-630179878fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6d80a26-0d37-439b-9f89-d2dd4e401da6', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:10 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721c571d-6611-45ff-b84d-691f97239cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:10 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-e3d10c2d-b2be-4a71-99b1-2870e987ce35-5794c9b3-b874-437b-8bd3-a89780ffcc40" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:10 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Creating volume 5794c9b3-b874-437b-8bd3-a89780ffcc40 from snapshot e3d10c2d-b2be-4a71-99b1-2870e987ce35 {{(pid=86801) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 08:27:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:10 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:10 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:10 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:27:10 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "cinder-quobyte-5794c9b3-b874-437b-8bd3-a89780ffcc40" by "_copy_volume_from_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:10 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Volume volume-e6d80a26-0d37-439b-9f89-d2dd4e401da6 (e6d80a26-0d37-439b-9f89-d2dd4e401da6): created successfully Nov 03 08:27:10 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721c571d-6611-45ff-b84d-691f97239cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:10 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Flow 'volume_create_manager' (cbb01fa7-287b-402c-9bdc-6853958afc6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:27:10 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-5794c9b3-b874-437b-8bd3-a89780ffcc40" acquired by "_copy_volume_from_snapshot" :: waited 0.047s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:10 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] snapshot: e3d10c2d-b2be-4a71-99b1-2870e987ce35, volume: 5794c9b3-b874-437b-8bd3-a89780ffcc40, {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 08:27:10 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-efd13db5-680d-4f9d-9635-4bdc527a3679 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Created volume successfully. Nov 03 08:27:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:10 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:10 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:10 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b11cf79-0c83-46dc-a884-b842b5658194]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.e3d10c2d-b2be-4a71-99b1-2870e987ce35 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:10 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.e3d10c2d-b2be-4a71-99b1-2870e987ce35 Nov 03 08:27:10 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:10 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.e3d10c2d-b2be-4a71-99b1-2870e987ce35" returned: 0 in 0.440s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:10 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0acaaa76-e65f-4ff2-88ec-823526ef4683(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:27:10 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3a03ba-d6ec-41f0-93bc-07e500afd5de]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:10 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683 Nov 03 08:27:10 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:11 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683" returned: 0 in 0.435s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:11 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683 {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 08:27:11 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Creating direct copy from snapshot {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 08:27:11 devstack cinder-volume[86801]: DEBUG cinder.utils [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Path /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5794c9b3-b874-437b-8bd3-a89780ffcc40 not found in is_blk_device check {{(pid=86801) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 08:27:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5794c9b3-b874-437b-8bd3-a89780ffcc40 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:11 devstack sudo[101170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5794c9b3-b874-437b-8bd3-a89780ffcc40 Nov 03 08:27:11 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:11 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:27:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Flow 'volume_create_manager' (f5e599ed-4c72-432e-84a2-b170a6292d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:27:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e0050c-564d-4666-b7f7-fa2d60b94712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e0050c-564d-4666-b7f7-fa2d60b94712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1283710463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4701475-36c7-40ec-8c07-5f13177ac46e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903cc8c4d97d448daa93d4efe7b26369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:27:11Z,use_quota=True,user_id='cc391535f1294c9d86afe93bc94cd3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76493e40-fda9-462c-9771-657f4b6ec5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76493e40-fda9-462c-9771-657f4b6ec5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea3db86-44d6-4716-b05c-958166dfc179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea3db86-44d6-4716-b05c-958166dfc179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4701475-36c7-40ec-8c07-5f13177ac46e', 'volume_name': 'volume-d4701475-36c7-40ec-8c07-5f13177ac46e', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a1874a-ef4c-417d-a98f-ffe0b475a7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a1874a-ef4c-417d-a98f-ffe0b475a7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a6ac60-40b5-466c-aa8a-0c12d4ae82b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:11 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Volume d4701475-36c7-40ec-8c07-5f13177ac46e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4701475-36c7-40ec-8c07-5f13177ac46e', 'volume_size': 1} Nov 03 08:27:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:19 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5794c9b3-b874-437b-8bd3-a89780ffcc40" returned: 0 in 7.929s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:19 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683, size 1024.00 MB, duration 7.93 sec, destination /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5794c9b3-b874-437b-8bd3-a89780ffcc40 {{(pid=86801) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 08:27:19 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Converted 1024.00 MB image at 129.11 MB/s Nov 03 08:27:19 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5794c9b3-b874-437b-8bd3-a89780ffcc40 is being set with open permissions: ugo+rw Nov 03 08:27:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5794c9b3-b874-437b-8bd3-a89780ffcc40 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:19 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5794c9b3-b874-437b-8bd3-a89780ffcc40 Nov 03 08:27:19 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:19 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5794c9b3-b874-437b-8bd3-a89780ffcc40" returned: 0 in 0.275s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:19 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-5794c9b3-b874-437b-8bd3-a89780ffcc40" released by "_copy_volume_from_snapshot" :: held 9.277s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:19 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-e3d10c2d-b2be-4a71-99b1-2870e987ce35-5794c9b3-b874-437b-8bd3-a89780ffcc40" released by "_create_volume_from_snapshot" :: held 9.399s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.447s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.794s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:19 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-658318273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acb50b83-119b-4030-8d10-ff4796fa8ce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230e216f22c1415da9a2c28b8e96d226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:27:09Z,use_quota=True,user_id='74c8472a3b54445f8452cb2304f12d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:27:19 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Creating volume acb50b83-119b-4030-8d10-ff4796fa8ce5 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:27:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:19 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:19 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:19 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:27:19 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:27:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-acb50b83-119b-4030-8d10-ff4796fa8ce5 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:19 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-acb50b83-119b-4030-8d10-ff4796fa8ce5 1073741824 Nov 03 08:27:19 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb16dc2-22a1-48e3-8d81-926c5fabfc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5794c9b3-b874-437b-8bd3-a89780ffcc40', 'volume_size': 2, 'snapshot_id': 'e3d10c2d-b2be-4a71-99b1-2870e987ce35'}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58169fcf-1c75-406e-97d2-cd6b9dc5e8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:19 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Volume volume-5794c9b3-b874-437b-8bd3-a89780ffcc40 (5794c9b3-b874-437b-8bd3-a89780ffcc40): created successfully Nov 03 08:27:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58169fcf-1c75-406e-97d2-cd6b9dc5e8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Flow 'volume_create_manager' (cd3a4227-745e-4855-9875-f6b88d48e714) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:27:19 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-c8bbd5e3-7f39-47ea-a050-32ef9006be25 tempest-VolumesSnapshotTestJSON-571293391 None] Created volume successfully. Nov 03 08:27:20 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-acb50b83-119b-4030-8d10-ff4796fa8ce5 1073741824" returned: 0 in 0.964s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-acb50b83-119b-4030-8d10-ff4796fa8ce5 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:20 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-3f77231a-828e-44ad-84d7-0ebae753ce11 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "cinder-5794c9b3-b874-437b-8bd3-a89780ffcc40-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:20 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-acb50b83-119b-4030-8d10-ff4796fa8ce5 Nov 03 08:27:20 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:20 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-3f77231a-828e-44ad-84d7-0ebae753ce11 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-5794c9b3-b874-437b-8bd3-a89780ffcc40-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:20 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-3f77231a-828e-44ad-84d7-0ebae753ce11 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "cinder-quobyte-5794c9b3-b874-437b-8bd3-a89780ffcc40" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:20 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-3f77231a-828e-44ad-84d7-0ebae753ce11 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-5794c9b3-b874-437b-8bd3-a89780ffcc40" acquired by "delete_volume" :: waited 0.025s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:20 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8527cd-1df5-4e5f-b891-7b937c83cb60]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3f77231a-828e-44ad-84d7-0ebae753ce11 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5794c9b3-b874-437b-8bd3-a89780ffcc40 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:20 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-acb50b83-119b-4030-8d10-ff4796fa8ce5" returned: 0 in 0.336s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:27:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.546s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1283710463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4701475-36c7-40ec-8c07-5f13177ac46e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903cc8c4d97d448daa93d4efe7b26369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:27:11Z,use_quota=True,user_id='cc391535f1294c9d86afe93bc94cd3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:27:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Creating volume d4701475-36c7-40ec-8c07-5f13177ac46e {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:27:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:27:20 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:27:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:20 devstack sudo[101281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5794c9b3-b874-437b-8bd3-a89780ffcc40 Nov 03 08:27:20 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd280d2f-56c9-425b-8ab7-5bf7e83697c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acb50b83-119b-4030-8d10-ff4796fa8ce5', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db4d762-a5e5-4caa-b038-e6b9f2a66388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:20 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e 1073741824 Nov 03 08:27:20 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:20 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Volume volume-acb50b83-119b-4030-8d10-ff4796fa8ce5 (acb50b83-119b-4030-8d10-ff4796fa8ce5): created successfully Nov 03 08:27:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db4d762-a5e5-4caa-b038-e6b9f2a66388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Flow 'volume_create_manager' (99d6671d-5cab-4e84-8171-deeb4be1b8bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:27:20 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-e73b990e-5ec0-4b06-89af-29dd4f3e9192 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Created volume successfully. Nov 03 08:27:21 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3f77231a-828e-44ad-84d7-0ebae753ce11 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5794c9b3-b874-437b-8bd3-a89780ffcc40" returned: 0 in 0.565s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3f77231a-828e-44ad-84d7-0ebae753ce11 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5794c9b3-b874-437b-8bd3-a89780ffcc40 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:21 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5794c9b3-b874-437b-8bd3-a89780ffcc40 Nov 03 08:27:21 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:21 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e 1073741824" returned: 0 in 0.717s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:21 devstack sudo[101299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e Nov 03 08:27:21 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:21 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3f77231a-828e-44ad-84d7-0ebae753ce11 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5794c9b3-b874-437b-8bd3-a89780ffcc40" returned: 0 in 0.394s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:21 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-3f77231a-828e-44ad-84d7-0ebae753ce11 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-5794c9b3-b874-437b-8bd3-a89780ffcc40" released by "delete_volume" :: held 1.022s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:21 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-3f77231a-828e-44ad-84d7-0ebae753ce11 tempest-VolumesSnapshotTestJSON-571293391 None] Created reservations ['0397071c-f654-4dd0-8c32-c9a46a8530bb', '0e4d0194-9508-4c22-bbc6-2c8d8d31317f', '41434fe0-f92b-41e4-8a46-31ab52a36b23', '8fd2a34b-b8a0-4556-9ae8-f0a637607a3b'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:27:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3f77231a-828e-44ad-84d7-0ebae753ce11 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3f77231a-828e-44ad-84d7-0ebae753ce11 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:21 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-3f77231a-828e-44ad-84d7-0ebae753ce11 tempest-VolumesSnapshotTestJSON-571293391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:21 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-3f77231a-828e-44ad-84d7-0ebae753ce11 tempest-VolumesSnapshotTestJSON-571293391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3f77231a-828e-44ad-84d7-0ebae753ce11 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3f77231a-828e-44ad-84d7-0ebae753ce11 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:21 devstack sudo[101301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:27:21 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:21 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e" returned: 0 in 0.302s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:21 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:27:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a6ac60-40b5-466c-aa8a-0c12d4ae82b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4701475-36c7-40ec-8c07-5f13177ac46e', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78bc14e5-aed8-4eec-a831-1018118f38da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:22 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Volume volume-d4701475-36c7-40ec-8c07-5f13177ac46e (d4701475-36c7-40ec-8c07-5f13177ac46e): created successfully Nov 03 08:27:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78bc14e5-aed8-4eec-a831-1018118f38da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Flow 'volume_create_manager' (f5e599ed-4c72-432e-84a2-b170a6292d7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:27:22 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-a733d27b-5851-4ae9-88db-62177eedb5a4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Created volume successfully. Nov 03 08:27:22 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3f77231a-828e-44ad-84d7-0ebae753ce11 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.285s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:22 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-3f77231a-828e-44ad-84d7-0ebae753ce11 tempest-VolumesSnapshotTestJSON-571293391 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:27:22 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-3f77231a-828e-44ad-84d7-0ebae753ce11 tempest-VolumesSnapshotTestJSON-571293391 None] Deleted volume successfully. Nov 03 08:27:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-3f77231a-828e-44ad-84d7-0ebae753ce11 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-5794c9b3-b874-437b-8bd3-a89780ffcc40-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ccca7458-8c46-4ee0-b724-acbf478171d2 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ccca7458-8c46-4ee0-b724-acbf478171d2 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:22 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-ccca7458-8c46-4ee0-b724-acbf478171d2 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Creating offline snapshot f540f330-bd7b-4577-99f5-ce449b5d5f93 of volume d4701475-36c7-40ec-8c07-5f13177ac46e {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:27:22 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[141c6e44-d23d-4ed3-9c99-96f212cefaa1]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ccca7458-8c46-4ee0-b724-acbf478171d2 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:22 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e Nov 03 08:27:22 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ba06943f-b116-4b22-9166-b7047a4157a1 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "cinder-e3d10c2d-b2be-4a71-99b1-2870e987ce35-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:23 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ba06943f-b116-4b22-9166-b7047a4157a1 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-e3d10c2d-b2be-4a71-99b1-2870e987ce35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:23 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ba06943f-b116-4b22-9166-b7047a4157a1 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "cinder-quobyte-0acaaa76-e65f-4ff2-88ec-823526ef4683" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:23 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ba06943f-b116-4b22-9166-b7047a4157a1 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-0acaaa76-e65f-4ff2-88ec-823526ef4683" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:23 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ba06943f-b116-4b22-9166-b7047a4157a1 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "cinder-quobyte-e3d10c2d-b2be-4a71-99b1-2870e987ce35" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:23 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ba06943f-b116-4b22-9166-b7047a4157a1 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-e3d10c2d-b2be-4a71-99b1-2870e987ce35" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-ba06943f-b116-4b22-9166-b7047a4157a1 tempest-VolumesSnapshotTestJSON-571293391 None] Deleting offline snapshot e3d10c2d-b2be-4a71-99b1-2870e987ce35 of volume 0acaaa76-e65f-4ff2-88ec-823526ef4683 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:27:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-ba06943f-b116-4b22-9166-b7047a4157a1 tempest-VolumesSnapshotTestJSON-571293391 None] snapshot_file for this snap is: volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.e3d10c2d-b2be-4a71-99b1-2870e987ce35 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:27:23 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[47037fbc-3ca2-487c-9237-b353400a0f82]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ba06943f-b116-4b22-9166-b7047a4157a1 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.e3d10c2d-b2be-4a71-99b1-2870e987ce35 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:23 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ccca7458-8c46-4ee0-b724-acbf478171d2 tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e" returned: 0 in 0.508s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ccca7458-8c46-4ee0-b724-acbf478171d2 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e.f540f330-bd7b-4577-99f5-ce449b5d5f93 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:23 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.e3d10c2d-b2be-4a71-99b1-2870e987ce35 Nov 03 08:27:23 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:23 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e.f540f330-bd7b-4577-99f5-ce449b5d5f93 1G Nov 03 08:27:23 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:23 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ba06943f-b116-4b22-9166-b7047a4157a1 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.e3d10c2d-b2be-4a71-99b1-2870e987ce35" returned: 0 in 0.426s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-ba06943f-b116-4b22-9166-b7047a4157a1 tempest-VolumesSnapshotTestJSON-571293391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0acaaa76-e65f-4ff2-88ec-823526ef4683(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:27:23 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[9883a7cb-d21d-480d-b86b-3fd810e1c1c4]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ba06943f-b116-4b22-9166-b7047a4157a1 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:23 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683 Nov 03 08:27:23 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:23 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ccca7458-8c46-4ee0-b724-acbf478171d2 tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e.f540f330-bd7b-4577-99f5-ce449b5d5f93 1G" returned: 0 in 0.661s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ccca7458-8c46-4ee0-b724-acbf478171d2 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4701475-36c7-40ec-8c07-5f13177ac46e -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e.f540f330-bd7b-4577-99f5-ce449b5d5f93 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:23 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4701475-36c7-40ec-8c07-5f13177ac46e -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e.f540f330-bd7b-4577-99f5-ce449b5d5f93 Nov 03 08:27:23 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:24 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ccca7458-8c46-4ee0-b724-acbf478171d2 tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4701475-36c7-40ec-8c07-5f13177ac46e -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e.f540f330-bd7b-4577-99f5-ce449b5d5f93" returned: 0 in 0.447s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:24 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-ccca7458-8c46-4ee0-b724-acbf478171d2 tempest-CreateVolumesFromSnapshotTest-1534897542 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e.f540f330-bd7b-4577-99f5-ce449b5d5f93 is being set with open permissions: ugo+rw Nov 03 08:27:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ccca7458-8c46-4ee0-b724-acbf478171d2 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e.f540f330-bd7b-4577-99f5-ce449b5d5f93 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:24 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e.f540f330-bd7b-4577-99f5-ce449b5d5f93 Nov 03 08:27:24 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:24 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ba06943f-b116-4b22-9166-b7047a4157a1 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683" returned: 0 in 0.770s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ba06943f-b116-4b22-9166-b7047a4157a1 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.e3d10c2d-b2be-4a71-99b1-2870e987ce35 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:24 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.e3d10c2d-b2be-4a71-99b1-2870e987ce35 Nov 03 08:27:24 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:24 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ccca7458-8c46-4ee0-b724-acbf478171d2 tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e.f540f330-bd7b-4577-99f5-ce449b5d5f93" returned: 0 in 0.340s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ccca7458-8c46-4ee0-b724-acbf478171d2 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:24 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e.info Nov 03 08:27:24 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:24 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ba06943f-b116-4b22-9166-b7047a4157a1 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.e3d10c2d-b2be-4a71-99b1-2870e987ce35" returned: 0 in 0.423s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ba06943f-b116-4b22-9166-b7047a4157a1 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.e3d10c2d-b2be-4a71-99b1-2870e987ce35 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:24 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.e3d10c2d-b2be-4a71-99b1-2870e987ce35 Nov 03 08:27:24 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:25 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ccca7458-8c46-4ee0-b724-acbf478171d2 tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e.info" returned: 0 in 0.339s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:25 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-ccca7458-8c46-4ee0-b724-acbf478171d2 tempest-CreateVolumesFromSnapshotTest-1534897542 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e.info is being set with open permissions: ugo+rw Nov 03 08:27:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ccca7458-8c46-4ee0-b724-acbf478171d2 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:25 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ba06943f-b116-4b22-9166-b7047a4157a1 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683.e3d10c2d-b2be-4a71-99b1-2870e987ce35" returned: 0 in 0.291s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:25 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e.info Nov 03 08:27:25 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ba06943f-b116-4b22-9166-b7047a4157a1 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-e3d10c2d-b2be-4a71-99b1-2870e987ce35" released by "_delete_snapshot" :: held 2.071s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ba06943f-b116-4b22-9166-b7047a4157a1 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-0acaaa76-e65f-4ff2-88ec-823526ef4683" released by "delete_snapshot" :: held 2.123s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:25 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-ba06943f-b116-4b22-9166-b7047a4157a1 tempest-VolumesSnapshotTestJSON-571293391 None] Created reservations ['28b2b9d8-0e5c-459d-a893-de6e21b93403', 'a104d7bc-37c1-40a0-a0d4-3ed2914f0c48', '89f24366-8479-4805-b287-f22156b602c4', '7aa3db5b-3893-4836-9b5b-3526967cf2ec'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:27:25 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-ba06943f-b116-4b22-9166-b7047a4157a1 tempest-VolumesSnapshotTestJSON-571293391 None] Delete snapshot completed successfully. Nov 03 08:27:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ba06943f-b116-4b22-9166-b7047a4157a1 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-e3d10c2d-b2be-4a71-99b1-2870e987ce35-delete_snapshot" released by "delete_snapshot" :: held 2.304s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:25 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ccca7458-8c46-4ee0-b724-acbf478171d2 tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e.info" returned: 0 in 0.292s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ccca7458-8c46-4ee0-b724-acbf478171d2 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.705s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:25 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-ccca7458-8c46-4ee0-b724-acbf478171d2 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Create snapshot completed successfully Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Flow 'volume_create_manager' (1b3d0891-f1e8-435b-84f7-9bd8c38c76b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e56c468d-1123-47cc-a5e0-6978191abce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-029640ab-3ab6-4a43-9800-fc4db7890131 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "cinder-0acaaa76-e65f-4ff2-88ec-823526ef4683-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e56c468d-1123-47cc-a5e0-6978191abce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-281029076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56deb0f3-78fa-468c-973a-6d77f95cd6fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903cc8c4d97d448daa93d4efe7b26369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:27:26Z,use_quota=True,user_id='cc391535f1294c9d86afe93bc94cd3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d435252d-ec0c-4e08-a798-8790c0e73636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d435252d-ec0c-4e08-a798-8790c0e73636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29e8a03-e5c6-486f-9aeb-f78df3ec6000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29e8a03-e5c6-486f-9aeb-f78df3ec6000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56deb0f3-78fa-468c-973a-6d77f95cd6fb', 'volume_name': 'volume-56deb0f3-78fa-468c-973a-6d77f95cd6fb', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7636719-07c0-4a05-a988-6f4d3523794e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7636719-07c0-4a05-a988-6f4d3523794e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa0c7b0-c29e-4f6f-87d6-104f70160274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:26 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Volume 56deb0f3-78fa-468c-973a-6d77f95cd6fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56deb0f3-78fa-468c-973a-6d77f95cd6fb', 'volume_size': 1} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-281029076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56deb0f3-78fa-468c-973a-6d77f95cd6fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903cc8c4d97d448daa93d4efe7b26369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:27:26Z,use_quota=True,user_id='cc391535f1294c9d86afe93bc94cd3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Creating volume 56deb0f3-78fa-468c-973a-6d77f95cd6fb {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:27:26 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-56deb0f3-78fa-468c-973a-6d77f95cd6fb 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-029640ab-3ab6-4a43-9800-fc4db7890131 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-0acaaa76-e65f-4ff2-88ec-823526ef4683-delete_volume" acquired by "delete_volume" :: waited 0.153s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:26 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-56deb0f3-78fa-468c-973a-6d77f95cd6fb 1073741824 Nov 03 08:27:26 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-029640ab-3ab6-4a43-9800-fc4db7890131 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "cinder-quobyte-0acaaa76-e65f-4ff2-88ec-823526ef4683" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-029640ab-3ab6-4a43-9800-fc4db7890131 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-0acaaa76-e65f-4ff2-88ec-823526ef4683" acquired by "delete_volume" :: waited 0.037s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd6f9fe-ed65-4a89-9b09-2005ce096b69]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-029640ab-3ab6-4a43-9800-fc4db7890131 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Flow 'volume_create_manager' (bd45c6ad-1966-4c01-9ceb-297c54265fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a2e67dc-eaa8-4e4d-987d-407c6c22ee68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a2e67dc-eaa8-4e4d-987d-407c6c22ee68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-698596173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b313d4cd-128b-40f6-923f-5276e8384a68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903cc8c4d97d448daa93d4efe7b26369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:27:27Z,use_quota=True,user_id='cc391535f1294c9d86afe93bc94cd3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e86b21-3d7a-4ee4-8efb-416452bba844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e86b21-3d7a-4ee4-8efb-416452bba844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3d31fc-138c-4823-bd4c-aeb7dfaa7c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3d31fc-138c-4823-bd4c-aeb7dfaa7c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b313d4cd-128b-40f6-923f-5276e8384a68', 'volume_name': 'volume-b313d4cd-128b-40f6-923f-5276e8384a68', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c14a6c53-caa1-4d21-be59-debf7287015a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c14a6c53-caa1-4d21-be59-debf7287015a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba46bf18-d159-4d12-ab5e-97bfcabb3c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:26 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Volume b313d4cd-128b-40f6-923f-5276e8384a68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b313d4cd-128b-40f6-923f-5276e8384a68', 'volume_size': 1} Nov 03 08:27:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:27 devstack sudo[101354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683 Nov 03 08:27:27 devstack sudo[101354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:27 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-56deb0f3-78fa-468c-973a-6d77f95cd6fb 1073741824" returned: 0 in 0.676s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-56deb0f3-78fa-468c-973a-6d77f95cd6fb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:27 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-56deb0f3-78fa-468c-973a-6d77f95cd6fb Nov 03 08:27:27 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:27 devstack sudo[101354]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Flow 'volume_create_manager' (1f98460b-f9f3-4417-894e-a095b0f85950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6696b804-d6b6-4e88-95b0-cd7b16977879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:INSERT=35,cinder:SELECT=110,cinder:UPDATE=107,cinder:DELETE=12 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-029640ab-3ab6-4a43-9800-fc4db7890131 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683" returned: 0 in 0.767s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-029640ab-3ab6-4a43-9800-fc4db7890131 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6696b804-d6b6-4e88-95b0-cd7b16977879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-225554204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27ee9db0-d72f-4ecd-b654-f527ac9db3e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903cc8c4d97d448daa93d4efe7b26369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:27:27Z,use_quota=True,user_id='cc391535f1294c9d86afe93bc94cd3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4223202b-0a0a-42ed-9f7a-66e7998613d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4223202b-0a0a-42ed-9f7a-66e7998613d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4957e73c-1849-4a7b-9770-40ca68c566dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4957e73c-1849-4a7b-9770-40ca68c566dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27ee9db0-d72f-4ecd-b654-f527ac9db3e8', 'volume_name': 'volume-27ee9db0-d72f-4ecd-b654-f527ac9db3e8', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61225262-21b5-4947-a5d6-6127d64d8a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61225262-21b5-4947-a5d6-6127d64d8a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c1c3c0a-d90b-48ff-a09c-06a8da23849b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:27 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Volume 27ee9db0-d72f-4ecd-b654-f527ac9db3e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27ee9db0-d72f-4ecd-b654-f527ac9db3e8', 'volume_size': 1} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:27 devstack sudo[101365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683 Nov 03 08:27:27 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:27 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-56deb0f3-78fa-468c-973a-6d77f95cd6fb" returned: 0 in 0.421s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.746s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-698596173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b313d4cd-128b-40f6-923f-5276e8384a68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903cc8c4d97d448daa93d4efe7b26369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:27:27Z,use_quota=True,user_id='cc391535f1294c9d86afe93bc94cd3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Creating volume b313d4cd-128b-40f6-923f-5276e8384a68 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:27:27 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b313d4cd-128b-40f6-923f-5276e8384a68 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=89,cinder:INSERT=37,cinder:UPDATE=99,cinder:DELETE=6 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa0c7b0-c29e-4f6f-87d6-104f70160274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56deb0f3-78fa-468c-973a-6d77f95cd6fb', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7eea5bd-e97c-4f5c-823c-744335fb14e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:27 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b313d4cd-128b-40f6-923f-5276e8384a68 1073741824 Nov 03 08:27:27 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:27 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Volume volume-56deb0f3-78fa-468c-973a-6d77f95cd6fb (56deb0f3-78fa-468c-973a-6d77f95cd6fb): created successfully Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7eea5bd-e97c-4f5c-823c-744335fb14e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Flow 'volume_create_manager' (1b3d0891-f1e8-435b-84f7-9bd8c38c76b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:27:27 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-efb57ee0-de52-4f91-a738-d267d9bfe4b4 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Created volume successfully. Nov 03 08:27:27 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Flow 'volume_create_manager' (5dc07a78-1b06-4058-a3df-3c275d7c4a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8885f4-e2fd-4056-9b8e-09a504fe61fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8885f4-e2fd-4056-9b8e-09a504fe61fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1589966040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b7dd7d-1827-43b8-af2f-c5050b74a65d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903cc8c4d97d448daa93d4efe7b26369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:27:28Z,use_quota=True,user_id='cc391535f1294c9d86afe93bc94cd3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24780475-b830-47e6-a189-896f47fcf2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24780475-b830-47e6-a189-896f47fcf2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d61cdc25-a7ae-4d9d-b6e9-9e59f72e1577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d61cdc25-a7ae-4d9d-b6e9-9e59f72e1577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09b7dd7d-1827-43b8-af2f-c5050b74a65d', 'volume_name': 'volume-09b7dd7d-1827-43b8-af2f-c5050b74a65d', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (433cc471-a98c-495f-b668-24f3f9a31750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (433cc471-a98c-495f-b668-24f3f9a31750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ebf90ff-0f22-4cb1-810e-f15b7a535de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:28 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Volume 09b7dd7d-1827-43b8-af2f-c5050b74a65d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09b7dd7d-1827-43b8-af2f-c5050b74a65d', 'volume_size': 1} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:28 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-029640ab-3ab6-4a43-9800-fc4db7890131 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0acaaa76-e65f-4ff2-88ec-823526ef4683" returned: 0 in 0.573s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-029640ab-3ab6-4a43-9800-fc4db7890131 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-0acaaa76-e65f-4ff2-88ec-823526ef4683" released by "delete_volume" :: held 1.439s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-029640ab-3ab6-4a43-9800-fc4db7890131 tempest-VolumesSnapshotTestJSON-571293391 None] Created reservations ['81212b81-863a-4256-95f1-d9b9eb52f75c', 'c069bf6f-75b2-41f8-9924-76effd61c835', '36c45bcc-d41e-4221-bd20-3e2ff3cc3be5', 'ec20125f-7f67-4e1e-82ee-f5bb7ec0bead'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-029640ab-3ab6-4a43-9800-fc4db7890131 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-029640ab-3ab6-4a43-9800-fc4db7890131 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-029640ab-3ab6-4a43-9800-fc4db7890131 tempest-VolumesSnapshotTestJSON-571293391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-029640ab-3ab6-4a43-9800-fc4db7890131 tempest-VolumesSnapshotTestJSON-571293391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-029640ab-3ab6-4a43-9800-fc4db7890131 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-029640ab-3ab6-4a43-9800-fc4db7890131 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:28 devstack sudo[101374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:27:28 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:28 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b313d4cd-128b-40f6-923f-5276e8384a68 1073741824" returned: 0 in 0.812s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b313d4cd-128b-40f6-923f-5276e8384a68 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:27:28 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b313d4cd-128b-40f6-923f-5276e8384a68 Nov 03 08:27:28 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Flow 'volume_create_manager' (aefa4051-aae4-4b97-ab37-6f75bba6de99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43de9454-1e34-4e7c-bff8-ecf714f522d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43de9454-1e34-4e7c-bff8-ecf714f522d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1494649155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d620eb-4b75-4b74-bdcd-1192fad9e63d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903cc8c4d97d448daa93d4efe7b26369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:27:29Z,use_quota=True,user_id='cc391535f1294c9d86afe93bc94cd3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970be49a-814b-459b-9dc1-6ecc872a0b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970be49a-814b-459b-9dc1-6ecc872a0b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea39726-5328-436c-ba42-3cf9dbcac96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea39726-5328-436c-ba42-3cf9dbcac96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15d620eb-4b75-4b74-bdcd-1192fad9e63d', 'volume_name': 'volume-15d620eb-4b75-4b74-bdcd-1192fad9e63d', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e48f007c-a449-419c-9efc-52bb1ed7fce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e48f007c-a449-419c-9efc-52bb1ed7fce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4a045ba-8633-4295-9d8d-9884e53a9690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:28 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Volume 15d620eb-4b75-4b74-bdcd-1192fad9e63d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15d620eb-4b75-4b74-bdcd-1192fad9e63d', 'volume_size': 1} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:28 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-029640ab-3ab6-4a43-9800-fc4db7890131 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.456s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-029640ab-3ab6-4a43-9800-fc4db7890131 tempest-VolumesSnapshotTestJSON-571293391 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:27:28 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-029640ab-3ab6-4a43-9800-fc4db7890131 tempest-VolumesSnapshotTestJSON-571293391 None] Deleted volume successfully. Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-029640ab-3ab6-4a43-9800-fc4db7890131 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-0acaaa76-e65f-4ff2-88ec-823526ef4683-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:28 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b313d4cd-128b-40f6-923f-5276e8384a68" returned: 0 in 0.378s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.327s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-225554204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27ee9db0-d72f-4ecd-b654-f527ac9db3e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903cc8c4d97d448daa93d4efe7b26369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:27:27Z,use_quota=True,user_id='cc391535f1294c9d86afe93bc94cd3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Creating volume 27ee9db0-d72f-4ecd-b654-f527ac9db3e8 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:27:29 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27ee9db0-d72f-4ecd-b654-f527ac9db3e8 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba46bf18-d159-4d12-ab5e-97bfcabb3c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b313d4cd-128b-40f6-923f-5276e8384a68', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:29 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27ee9db0-d72f-4ecd-b654-f527ac9db3e8 1073741824 Nov 03 08:27:29 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfaf6d34-8027-43f3-88aa-eb1b68f0972e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:29 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Volume volume-b313d4cd-128b-40f6-923f-5276e8384a68 (b313d4cd-128b-40f6-923f-5276e8384a68): created successfully Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfaf6d34-8027-43f3-88aa-eb1b68f0972e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Flow 'volume_create_manager' (bd45c6ad-1966-4c01-9ceb-297c54265fde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:27:29 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-df59af58-439c-4d8b-9262-baa11b6222cc tempest-CreateVolumesFromSnapshotTest-1534897542 None] Created volume successfully. Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Flow 'volume_create_manager' (86a39d27-94a4-4577-a1d6-6bcedbe06da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4431a91e-7a2a-44db-a9f7-63cb6e9171e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4431a91e-7a2a-44db-a9f7-63cb6e9171e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-285946430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ba48edd-b5ae-492a-a245-9377d4b28fec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed84dccfbba4ebb92a9cfd6436f7c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:27:29Z,use_quota=True,user_id='425d80f26f794fe8beb2ec93fb8902b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a1ca910-c860-4cd8-a4ea-556b504fb00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a1ca910-c860-4cd8-a4ea-556b504fb00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241d0e26-794a-4df5-81b1-ec4b96867633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241d0e26-794a-4df5-81b1-ec4b96867633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ba48edd-b5ae-492a-a245-9377d4b28fec', 'volume_name': 'volume-7ba48edd-b5ae-492a-a245-9377d4b28fec', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cf71638-f70a-430b-9550-d7964af99f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:29 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cf71638-f70a-430b-9550-d7964af99f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba8c56e-473d-4711-9b28-a4459543936b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:29 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Volume 7ba48edd-b5ae-492a-a245-9377d4b28fec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ba48edd-b5ae-492a-a245-9377d4b28fec', 'volume_size': 1} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27ee9db0-d72f-4ecd-b654-f527ac9db3e8 1073741824" returned: 0 in 0.549s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27ee9db0-d72f-4ecd-b654-f527ac9db3e8 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:29 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27ee9db0-d72f-4ecd-b654-f527ac9db3e8 Nov 03 08:27:29 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:29 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27ee9db0-d72f-4ecd-b654-f527ac9db3e8" returned: 0 in 0.264s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.760s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1589966040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b7dd7d-1827-43b8-af2f-c5050b74a65d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903cc8c4d97d448daa93d4efe7b26369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:27:28Z,use_quota=True,user_id='cc391535f1294c9d86afe93bc94cd3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Creating volume 09b7dd7d-1827-43b8-af2f-c5050b74a65d {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:27:29 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09b7dd7d-1827-43b8-af2f-c5050b74a65d 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c1c3c0a-d90b-48ff-a09c-06a8da23849b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27ee9db0-d72f-4ecd-b654-f527ac9db3e8', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:29 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09b7dd7d-1827-43b8-af2f-c5050b74a65d 1073741824 Nov 03 08:27:29 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9fb49fb-d60b-4449-8c5b-0a88710e0407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:29 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Volume volume-27ee9db0-d72f-4ecd-b654-f527ac9db3e8 (27ee9db0-d72f-4ecd-b654-f527ac9db3e8): created successfully Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9fb49fb-d60b-4449-8c5b-0a88710e0407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Flow 'volume_create_manager' (1f98460b-f9f3-4417-894e-a095b0f85950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:27:29 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-edb24601-6076-4ca2-b98b-6e3feb3c4263 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Created volume successfully. Nov 03 08:27:30 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09b7dd7d-1827-43b8-af2f-c5050b74a65d 1073741824" returned: 0 in 0.469s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09b7dd7d-1827-43b8-af2f-c5050b74a65d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:30 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09b7dd7d-1827-43b8-af2f-c5050b74a65d Nov 03 08:27:30 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:30 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09b7dd7d-1827-43b8-af2f-c5050b74a65d" returned: 0 in 0.255s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:27:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.870s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1494649155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d620eb-4b75-4b74-bdcd-1192fad9e63d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903cc8c4d97d448daa93d4efe7b26369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:27:29Z,use_quota=True,user_id='cc391535f1294c9d86afe93bc94cd3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:27:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Creating volume 15d620eb-4b75-4b74-bdcd-1192fad9e63d {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:27:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:27:30 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:27:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-15d620eb-4b75-4b74-bdcd-1192fad9e63d 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:30 devstack sudo[101398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-15d620eb-4b75-4b74-bdcd-1192fad9e63d 1073741824 Nov 03 08:27:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ebf90ff-0f22-4cb1-810e-f15b7a535de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09b7dd7d-1827-43b8-af2f-c5050b74a65d', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:30 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ff45cc-ee9c-4709-9db2-3b68ae1591c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:30 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Volume volume-09b7dd7d-1827-43b8-af2f-c5050b74a65d (09b7dd7d-1827-43b8-af2f-c5050b74a65d): created successfully Nov 03 08:27:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ff45cc-ee9c-4709-9db2-3b68ae1591c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Flow 'volume_create_manager' (5dc07a78-1b06-4058-a3df-3c275d7c4a2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:27:30 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-1daa86a2-841f-4940-91f1-d2ef12cc793a tempest-CreateVolumesFromSnapshotTest-1534897542 None] Created volume successfully. Nov 03 08:27:31 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-15d620eb-4b75-4b74-bdcd-1192fad9e63d 1073741824" returned: 0 in 0.441s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-15d620eb-4b75-4b74-bdcd-1192fad9e63d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:31 devstack sudo[101403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-15d620eb-4b75-4b74-bdcd-1192fad9e63d Nov 03 08:27:31 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:31 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-15d620eb-4b75-4b74-bdcd-1192fad9e63d" returned: 0 in 0.260s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:27:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.847s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-285946430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ba48edd-b5ae-492a-a245-9377d4b28fec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed84dccfbba4ebb92a9cfd6436f7c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:27:29Z,use_quota=True,user_id='425d80f26f794fe8beb2ec93fb8902b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:27:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Creating volume 7ba48edd-b5ae-492a-a245-9377d4b28fec {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:27:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:27:31 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:27:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:31 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec 1073741824 Nov 03 08:27:31 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4a045ba-8633-4295-9d8d-9884e53a9690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15d620eb-4b75-4b74-bdcd-1192fad9e63d', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1218e570-7283-49d7-bdd1-270f6bf0336a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:31 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Volume volume-15d620eb-4b75-4b74-bdcd-1192fad9e63d (15d620eb-4b75-4b74-bdcd-1192fad9e63d): created successfully Nov 03 08:27:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1218e570-7283-49d7-bdd1-270f6bf0336a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Flow 'volume_create_manager' (aefa4051-aae4-4b97-ab37-6f75bba6de99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:27:31 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-bc6961a9-fc5d-4cd6-880a-c187ffebf805 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Created volume successfully. Nov 03 08:27:31 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec 1073741824" returned: 0 in 0.408s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:31 devstack sudo[101411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec Nov 03 08:27:31 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:32 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ffd526c2-c63a-4c67-b735-11bb2972f03e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "cinder-15d620eb-4b75-4b74-bdcd-1192fad9e63d-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:32 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ffd526c2-c63a-4c67-b735-11bb2972f03e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-15d620eb-4b75-4b74-bdcd-1192fad9e63d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:32 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ffd526c2-c63a-4c67-b735-11bb2972f03e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "cinder-quobyte-15d620eb-4b75-4b74-bdcd-1192fad9e63d" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:32 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ffd526c2-c63a-4c67-b735-11bb2972f03e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-quobyte-15d620eb-4b75-4b74-bdcd-1192fad9e63d" acquired by "delete_volume" :: waited 0.015s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:32 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec" returned: 0 in 0.333s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:32 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:27:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba8c56e-473d-4711-9b28-a4459543936b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ba48edd-b5ae-492a-a245-9377d4b28fec', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (782b6233-5824-4158-8cb3-f35e4202bac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:32 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f934f1b-e56b-4f1b-a833-af2c9d65926f]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ffd526c2-c63a-4c67-b735-11bb2972f03e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-15d620eb-4b75-4b74-bdcd-1192fad9e63d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:32 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Volume volume-7ba48edd-b5ae-492a-a245-9377d4b28fec (7ba48edd-b5ae-492a-a245-9377d4b28fec): created successfully Nov 03 08:27:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (782b6233-5824-4158-8cb3-f35e4202bac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Flow 'volume_create_manager' (86a39d27-94a4-4577-a1d6-6bcedbe06da6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:27:32 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-04f5ea99-02e3-4604-999b-84744fc76815 tempest-VolumesSnapshotTestJSON-571293391 None] Created volume successfully. Nov 03 08:27:32 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-15d620eb-4b75-4b74-bdcd-1192fad9e63d Nov 03 08:27:32 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:32 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ffd526c2-c63a-4c67-b735-11bb2972f03e tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-15d620eb-4b75-4b74-bdcd-1192fad9e63d" returned: 0 in 0.391s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ffd526c2-c63a-4c67-b735-11bb2972f03e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-15d620eb-4b75-4b74-bdcd-1192fad9e63d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:32 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-15d620eb-4b75-4b74-bdcd-1192fad9e63d Nov 03 08:27:32 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7575dcbd-8bb8-4e0c-9b73-483ae0e20956 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7575dcbd-8bb8-4e0c-9b73-483ae0e20956 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:32 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-7575dcbd-8bb8-4e0c-9b73-483ae0e20956 tempest-VolumesSnapshotTestJSON-571293391 None] Creating offline snapshot 4e4da53a-7c5b-4e87-be20-82155c1c8bee of volume 7ba48edd-b5ae-492a-a245-9377d4b28fec {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:27:32 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1bad7b-0fe6-4462-a307-6b8cb5ff858c]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7575dcbd-8bb8-4e0c-9b73-483ae0e20956 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:32 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ffd526c2-c63a-4c67-b735-11bb2972f03e tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-15d620eb-4b75-4b74-bdcd-1192fad9e63d" returned: 0 in 0.279s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:32 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ffd526c2-c63a-4c67-b735-11bb2972f03e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-quobyte-15d620eb-4b75-4b74-bdcd-1192fad9e63d" released by "delete_volume" :: held 0.744s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:32 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec Nov 03 08:27:32 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:32 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-ffd526c2-c63a-4c67-b735-11bb2972f03e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Created reservations ['a00093fe-8829-4f5c-bebc-f8911b878ba3', 'f557fcf4-1b74-464b-a9f4-d7a74f244b04', 'a8b41afe-3902-4b8f-9a51-cd2f1a3e170b', '215a5ebb-5cf8-42ac-870e-e588249168fc'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:27:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ffd526c2-c63a-4c67-b735-11bb2972f03e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ffd526c2-c63a-4c67-b735-11bb2972f03e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ffd526c2-c63a-4c67-b735-11bb2972f03e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ffd526c2-c63a-4c67-b735-11bb2972f03e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ffd526c2-c63a-4c67-b735-11bb2972f03e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ffd526c2-c63a-4c67-b735-11bb2972f03e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:33 devstack sudo[101425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:27:33 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:33 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7575dcbd-8bb8-4e0c-9b73-483ae0e20956 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec" returned: 0 in 0.435s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7575dcbd-8bb8-4e0c-9b73-483ae0e20956 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.4e4da53a-7c5b-4e87-be20-82155c1c8bee 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6d618a54-c205-4d33-b527-6f084a3bd64d tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "cinder-09b7dd7d-1827-43b8-af2f-c5050b74a65d-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:33 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.4e4da53a-7c5b-4e87-be20-82155c1c8bee 1G Nov 03 08:27:33 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6d618a54-c205-4d33-b527-6f084a3bd64d tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-09b7dd7d-1827-43b8-af2f-c5050b74a65d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:33 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ffd526c2-c63a-4c67-b735-11bb2972f03e tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.341s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:33 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-ffd526c2-c63a-4c67-b735-11bb2972f03e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:27:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6d618a54-c205-4d33-b527-6f084a3bd64d tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "cinder-quobyte-09b7dd7d-1827-43b8-af2f-c5050b74a65d" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:33 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-ffd526c2-c63a-4c67-b735-11bb2972f03e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Deleted volume successfully. Nov 03 08:27:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6d618a54-c205-4d33-b527-6f084a3bd64d tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-quobyte-09b7dd7d-1827-43b8-af2f-c5050b74a65d" acquired by "delete_volume" :: waited 0.029s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ffd526c2-c63a-4c67-b735-11bb2972f03e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-15d620eb-4b75-4b74-bdcd-1192fad9e63d-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:33 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e47820-bcb3-4b64-8c23-336dabb89751]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6d618a54-c205-4d33-b527-6f084a3bd64d tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09b7dd7d-1827-43b8-af2f-c5050b74a65d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:33 devstack sudo[101433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09b7dd7d-1827-43b8-af2f-c5050b74a65d Nov 03 08:27:33 devstack sudo[101433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:33 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7575dcbd-8bb8-4e0c-9b73-483ae0e20956 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.4e4da53a-7c5b-4e87-be20-82155c1c8bee 1G" returned: 0 in 0.536s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7575dcbd-8bb8-4e0c-9b73-483ae0e20956 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ba48edd-b5ae-492a-a245-9377d4b28fec -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.4e4da53a-7c5b-4e87-be20-82155c1c8bee {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:33 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ba48edd-b5ae-492a-a245-9377d4b28fec -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.4e4da53a-7c5b-4e87-be20-82155c1c8bee Nov 03 08:27:33 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:33 devstack sudo[101433]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6d618a54-c205-4d33-b527-6f084a3bd64d tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09b7dd7d-1827-43b8-af2f-c5050b74a65d" returned: 0 in 0.406s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6d618a54-c205-4d33-b527-6f084a3bd64d tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09b7dd7d-1827-43b8-af2f-c5050b74a65d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:33 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09b7dd7d-1827-43b8-af2f-c5050b74a65d Nov 03 08:27:33 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:34 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7575dcbd-8bb8-4e0c-9b73-483ae0e20956 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ba48edd-b5ae-492a-a245-9377d4b28fec -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.4e4da53a-7c5b-4e87-be20-82155c1c8bee" returned: 0 in 0.302s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:34 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-7575dcbd-8bb8-4e0c-9b73-483ae0e20956 tempest-VolumesSnapshotTestJSON-571293391 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.4e4da53a-7c5b-4e87-be20-82155c1c8bee is being set with open permissions: ugo+rw Nov 03 08:27:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7575dcbd-8bb8-4e0c-9b73-483ae0e20956 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.4e4da53a-7c5b-4e87-be20-82155c1c8bee {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:34 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.4e4da53a-7c5b-4e87-be20-82155c1c8bee Nov 03 08:27:34 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:34 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6d618a54-c205-4d33-b527-6f084a3bd64d tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-09b7dd7d-1827-43b8-af2f-c5050b74a65d" returned: 0 in 0.281s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6d618a54-c205-4d33-b527-6f084a3bd64d tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-quobyte-09b7dd7d-1827-43b8-af2f-c5050b74a65d" released by "delete_volume" :: held 0.737s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:34 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-6d618a54-c205-4d33-b527-6f084a3bd64d tempest-CreateVolumesFromSnapshotTest-1534897542 None] Created reservations ['3ae6bacd-392e-4f74-96d3-cb6b02f1def9', 'c65cfe20-4b88-4850-b813-bcb8897da076', 'd9fd664d-3203-4f44-ab10-e5c18fb66735', 'b58eacf8-6cfe-42d2-88f6-7773664e5304'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:27:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6d618a54-c205-4d33-b527-6f084a3bd64d tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6d618a54-c205-4d33-b527-6f084a3bd64d tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:34 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6d618a54-c205-4d33-b527-6f084a3bd64d tempest-CreateVolumesFromSnapshotTest-1534897542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:34 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6d618a54-c205-4d33-b527-6f084a3bd64d tempest-CreateVolumesFromSnapshotTest-1534897542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6d618a54-c205-4d33-b527-6f084a3bd64d tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6d618a54-c205-4d33-b527-6f084a3bd64d tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:34 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:27:34 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:34 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7575dcbd-8bb8-4e0c-9b73-483ae0e20956 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.4e4da53a-7c5b-4e87-be20-82155c1c8bee" returned: 0 in 0.263s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7575dcbd-8bb8-4e0c-9b73-483ae0e20956 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:34 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.info Nov 03 08:27:34 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8a98e74f-358a-4076-9d99-9fc869552ddf tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "cinder-27ee9db0-d72f-4ecd-b654-f527ac9db3e8-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8a98e74f-358a-4076-9d99-9fc869552ddf tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-27ee9db0-d72f-4ecd-b654-f527ac9db3e8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:34 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6d618a54-c205-4d33-b527-6f084a3bd64d tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.273s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:34 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-6d618a54-c205-4d33-b527-6f084a3bd64d tempest-CreateVolumesFromSnapshotTest-1534897542 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:27:34 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-6d618a54-c205-4d33-b527-6f084a3bd64d tempest-CreateVolumesFromSnapshotTest-1534897542 None] Deleted volume successfully. Nov 03 08:27:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8a98e74f-358a-4076-9d99-9fc869552ddf tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "cinder-quobyte-27ee9db0-d72f-4ecd-b654-f527ac9db3e8" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6d618a54-c205-4d33-b527-6f084a3bd64d tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-09b7dd7d-1827-43b8-af2f-c5050b74a65d-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8a98e74f-358a-4076-9d99-9fc869552ddf tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-quobyte-27ee9db0-d72f-4ecd-b654-f527ac9db3e8" acquired by "delete_volume" :: waited 0.022s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:34 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdbff8b-fd78-4ec2-9fb1-d765113366c2]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8a98e74f-358a-4076-9d99-9fc869552ddf tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27ee9db0-d72f-4ecd-b654-f527ac9db3e8 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:34 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7575dcbd-8bb8-4e0c-9b73-483ae0e20956 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.info" returned: 0 in 0.312s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:34 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-7575dcbd-8bb8-4e0c-9b73-483ae0e20956 tempest-VolumesSnapshotTestJSON-571293391 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.info is being set with open permissions: ugo+rw Nov 03 08:27:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7575dcbd-8bb8-4e0c-9b73-483ae0e20956 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:34 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.info Nov 03 08:27:34 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:34 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27ee9db0-d72f-4ecd-b654-f527ac9db3e8 Nov 03 08:27:34 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:34 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7575dcbd-8bb8-4e0c-9b73-483ae0e20956 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.info" returned: 0 in 0.276s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7575dcbd-8bb8-4e0c-9b73-483ae0e20956 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.226s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:35 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8a98e74f-358a-4076-9d99-9fc869552ddf tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27ee9db0-d72f-4ecd-b654-f527ac9db3e8" returned: 0 in 0.399s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8a98e74f-358a-4076-9d99-9fc869552ddf tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27ee9db0-d72f-4ecd-b654-f527ac9db3e8 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:35 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-7575dcbd-8bb8-4e0c-9b73-483ae0e20956 tempest-VolumesSnapshotTestJSON-571293391 None] Create snapshot completed successfully Nov 03 08:27:35 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27ee9db0-d72f-4ecd-b654-f527ac9db3e8 Nov 03 08:27:35 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:35 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8a98e74f-358a-4076-9d99-9fc869552ddf tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-27ee9db0-d72f-4ecd-b654-f527ac9db3e8" returned: 0 in 0.245s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8a98e74f-358a-4076-9d99-9fc869552ddf tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-quobyte-27ee9db0-d72f-4ecd-b654-f527ac9db3e8" released by "delete_volume" :: held 0.686s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:35 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-8a98e74f-358a-4076-9d99-9fc869552ddf tempest-CreateVolumesFromSnapshotTest-1534897542 None] Created reservations ['8c9d0474-6253-4cbb-b571-1b80a911ea8c', 'c9479ab2-049f-438f-8f23-39c03b6efdb6', '33fc58af-67c4-4558-bd3b-a8eb5ca79741', 'e123904b-d87e-46e9-ba71-a5b0ef28c2f9'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:27:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8a98e74f-358a-4076-9d99-9fc869552ddf tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8a98e74f-358a-4076-9d99-9fc869552ddf tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8a98e74f-358a-4076-9d99-9fc869552ddf tempest-CreateVolumesFromSnapshotTest-1534897542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8a98e74f-358a-4076-9d99-9fc869552ddf tempest-CreateVolumesFromSnapshotTest-1534897542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8a98e74f-358a-4076-9d99-9fc869552ddf tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8a98e74f-358a-4076-9d99-9fc869552ddf tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:35 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:27:35 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:35 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9cc6c3ff-5f76-46a6-9762-b93e201f7a98 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "cinder-b313d4cd-128b-40f6-923f-5276e8384a68-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8a98e74f-358a-4076-9d99-9fc869552ddf tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.260s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:35 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-8a98e74f-358a-4076-9d99-9fc869552ddf tempest-CreateVolumesFromSnapshotTest-1534897542 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:27:35 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-8a98e74f-358a-4076-9d99-9fc869552ddf tempest-CreateVolumesFromSnapshotTest-1534897542 None] Deleted volume successfully. Nov 03 08:27:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9cc6c3ff-5f76-46a6-9762-b93e201f7a98 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-b313d4cd-128b-40f6-923f-5276e8384a68-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8a98e74f-358a-4076-9d99-9fc869552ddf tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-27ee9db0-d72f-4ecd-b654-f527ac9db3e8-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9cc6c3ff-5f76-46a6-9762-b93e201f7a98 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "cinder-quobyte-b313d4cd-128b-40f6-923f-5276e8384a68" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9cc6c3ff-5f76-46a6-9762-b93e201f7a98 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-quobyte-b313d4cd-128b-40f6-923f-5276e8384a68" acquired by "delete_volume" :: waited 0.015s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:35 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd82a3ff-f696-4843-afb2-c579e7285fbb]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9cc6c3ff-5f76-46a6-9762-b93e201f7a98 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b313d4cd-128b-40f6-923f-5276e8384a68 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:35 devstack sudo[101491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b313d4cd-128b-40f6-923f-5276e8384a68 Nov 03 08:27:35 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:36 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9cc6c3ff-5f76-46a6-9762-b93e201f7a98 tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b313d4cd-128b-40f6-923f-5276e8384a68" returned: 0 in 0.373s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9cc6c3ff-5f76-46a6-9762-b93e201f7a98 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b313d4cd-128b-40f6-923f-5276e8384a68 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:36 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b313d4cd-128b-40f6-923f-5276e8384a68 Nov 03 08:27:36 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:36 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9cc6c3ff-5f76-46a6-9762-b93e201f7a98 tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b313d4cd-128b-40f6-923f-5276e8384a68" returned: 0 in 0.296s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Flow 'volume_create_manager' (3fbc1e01-0605-424e-afa5-5ed51070e826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34489162-a5bf-49e0-a662-4eb9fa29d946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9cc6c3ff-5f76-46a6-9762-b93e201f7a98 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-quobyte-b313d4cd-128b-40f6-923f-5276e8384a68" released by "delete_volume" :: held 0.738s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34489162-a5bf-49e0-a662-4eb9fa29d946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-767320683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4970a6a0-71be-452f-b218-7721debe031f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed84dccfbba4ebb92a9cfd6436f7c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4e4da53a-7c5b-4e87-be20-82155c1c8bee,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:27:36Z,use_quota=True,user_id='425d80f26f794fe8beb2ec93fb8902b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (949e9297-b537-4ff8-bd8c-f0c14f14dd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (949e9297-b537-4ff8-bd8c-f0c14f14dd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db239886-58ac-4792-8ea9-287a4e1e66ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db239886-58ac-4792-8ea9-287a4e1e66ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4970a6a0-71be-452f-b218-7721debe031f', 'volume_name': 'volume-4970a6a0-71be-452f-b218-7721debe031f', 'volume_size': 1, 'snapshot_id': '4e4da53a-7c5b-4e87-be20-82155c1c8bee'}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a27320-8b2f-49cc-999b-0e1235971a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a27320-8b2f-49cc-999b-0e1235971a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754a0503-6027-41ae-9b28-33ff6ab14cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:36 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Volume 4970a6a0-71be-452f-b218-7721debe031f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4970a6a0-71be-452f-b218-7721debe031f', 'volume_size': 1, 'snapshot_id': '4e4da53a-7c5b-4e87-be20-82155c1c8bee'} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "cinder-quobyte-4e4da53a-7c5b-4e87-be20-82155c1c8bee-4970a6a0-71be-452f-b218-7721debe031f" by "_create_volume_from_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-4e4da53a-7c5b-4e87-be20-82155c1c8bee-4970a6a0-71be-452f-b218-7721debe031f" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Creating volume 4970a6a0-71be-452f-b218-7721debe031f from snapshot 4e4da53a-7c5b-4e87-be20-82155c1c8bee {{(pid=86801) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "cinder-quobyte-4970a6a0-71be-452f-b218-7721debe031f" by "_copy_volume_from_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-4970a6a0-71be-452f-b218-7721debe031f" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] snapshot: 4e4da53a-7c5b-4e87-be20-82155c1c8bee, volume: 4970a6a0-71be-452f-b218-7721debe031f, {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-9cc6c3ff-5f76-46a6-9762-b93e201f7a98 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Created reservations ['75a5b244-7477-4c48-b8b9-ca4ae54f290c', '01f9802c-187b-4fbd-a4be-5769e62747bf', '472e5c98-c7ff-4df3-9232-ff37f78e164c', '8964005a-8737-4dbe-a717-8881a6b14c36'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a99297c-9397-4883-abbe-955236298a1d]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.4e4da53a-7c5b-4e87-be20-82155c1c8bee {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9cc6c3ff-5f76-46a6-9762-b93e201f7a98 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9cc6c3ff-5f76-46a6-9762-b93e201f7a98 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9cc6c3ff-5f76-46a6-9762-b93e201f7a98 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9cc6c3ff-5f76-46a6-9762-b93e201f7a98 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9cc6c3ff-5f76-46a6-9762-b93e201f7a98 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9cc6c3ff-5f76-46a6-9762-b93e201f7a98 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:36 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:27:36 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:36 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.4e4da53a-7c5b-4e87-be20-82155c1c8bee Nov 03 08:27:36 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-63424fad-2906-4be0-8ea8-a3b9342c3792 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "cinder-56deb0f3-78fa-468c-973a-6d77f95cd6fb-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-63424fad-2906-4be0-8ea8-a3b9342c3792 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-56deb0f3-78fa-468c-973a-6d77f95cd6fb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-63424fad-2906-4be0-8ea8-a3b9342c3792 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "cinder-quobyte-56deb0f3-78fa-468c-973a-6d77f95cd6fb" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-63424fad-2906-4be0-8ea8-a3b9342c3792 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-quobyte-56deb0f3-78fa-468c-973a-6d77f95cd6fb" acquired by "delete_volume" :: waited 0.024s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cffee33-2b78-4e41-8722-59e80a866611]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-63424fad-2906-4be0-8ea8-a3b9342c3792 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-56deb0f3-78fa-468c-973a-6d77f95cd6fb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:37 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9cc6c3ff-5f76-46a6-9762-b93e201f7a98 tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.297s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:37 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-9cc6c3ff-5f76-46a6-9762-b93e201f7a98 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:27:37 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-9cc6c3ff-5f76-46a6-9762-b93e201f7a98 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Deleted volume successfully. Nov 03 08:27:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9cc6c3ff-5f76-46a6-9762-b93e201f7a98 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-b313d4cd-128b-40f6-923f-5276e8384a68-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:37 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.4e4da53a-7c5b-4e87-be20-82155c1c8bee" returned: 0 in 0.451s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ba48edd-b5ae-492a-a245-9377d4b28fec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:27:37 devstack sudo[101505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-56deb0f3-78fa-468c-973a-6d77f95cd6fb Nov 03 08:27:37 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:37 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d80ddc-d47d-4afe-b45d-b7defda9e253]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:37 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec Nov 03 08:27:37 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:37 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-63424fad-2906-4be0-8ea8-a3b9342c3792 tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-56deb0f3-78fa-468c-973a-6d77f95cd6fb" returned: 0 in 0.422s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-63424fad-2906-4be0-8ea8-a3b9342c3792 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-56deb0f3-78fa-468c-973a-6d77f95cd6fb {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:37 devstack sudo[101516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-56deb0f3-78fa-468c-973a-6d77f95cd6fb Nov 03 08:27:37 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:37 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec" returned: 0 in 0.407s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 08:27:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Creating direct copy from snapshot {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 08:27:37 devstack cinder-volume[86801]: DEBUG cinder.utils [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Path /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4970a6a0-71be-452f-b218-7721debe031f not found in is_blk_device check {{(pid=86801) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 08:27:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4970a6a0-71be-452f-b218-7721debe031f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:37 devstack sudo[101521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4970a6a0-71be-452f-b218-7721debe031f Nov 03 08:27:37 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:37 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-63424fad-2906-4be0-8ea8-a3b9342c3792 tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-56deb0f3-78fa-468c-973a-6d77f95cd6fb" returned: 0 in 0.264s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-63424fad-2906-4be0-8ea8-a3b9342c3792 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-quobyte-56deb0f3-78fa-468c-973a-6d77f95cd6fb" released by "delete_volume" :: held 0.754s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:37 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-63424fad-2906-4be0-8ea8-a3b9342c3792 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Created reservations ['243a764a-8ecc-48f1-b174-6914712a9876', 'd2cdb4d8-78bb-4842-82b8-e19ac918c516', 'ee62a3be-491e-4a7f-92f1-68f669eb9793', '5b408f72-3139-4b76-a3ca-f70b19fd5769'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:27:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-63424fad-2906-4be0-8ea8-a3b9342c3792 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-63424fad-2906-4be0-8ea8-a3b9342c3792 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-63424fad-2906-4be0-8ea8-a3b9342c3792 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-63424fad-2906-4be0-8ea8-a3b9342c3792 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-63424fad-2906-4be0-8ea8-a3b9342c3792 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-63424fad-2906-4be0-8ea8-a3b9342c3792 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:37 devstack sudo[101527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:27:37 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1f027f3f-aed9-4f67-8b10-a9467580ad94 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "cinder-f540f330-bd7b-4577-99f5-ce449b5d5f93-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1f027f3f-aed9-4f67-8b10-a9467580ad94 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-f540f330-bd7b-4577-99f5-ce449b5d5f93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1f027f3f-aed9-4f67-8b10-a9467580ad94 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "cinder-quobyte-d4701475-36c7-40ec-8c07-5f13177ac46e" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1f027f3f-aed9-4f67-8b10-a9467580ad94 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-quobyte-d4701475-36c7-40ec-8c07-5f13177ac46e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1f027f3f-aed9-4f67-8b10-a9467580ad94 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "cinder-quobyte-f540f330-bd7b-4577-99f5-ce449b5d5f93" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:38 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1f027f3f-aed9-4f67-8b10-a9467580ad94 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-quobyte-f540f330-bd7b-4577-99f5-ce449b5d5f93" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-1f027f3f-aed9-4f67-8b10-a9467580ad94 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Deleting offline snapshot f540f330-bd7b-4577-99f5-ce449b5d5f93 of volume d4701475-36c7-40ec-8c07-5f13177ac46e {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:27:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-1f027f3f-aed9-4f67-8b10-a9467580ad94 tempest-CreateVolumesFromSnapshotTest-1534897542 None] snapshot_file for this snap is: volume-d4701475-36c7-40ec-8c07-5f13177ac46e.f540f330-bd7b-4577-99f5-ce449b5d5f93 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:27:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-63424fad-2906-4be0-8ea8-a3b9342c3792 tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.396s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:38 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-63424fad-2906-4be0-8ea8-a3b9342c3792 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:27:38 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-63424fad-2906-4be0-8ea8-a3b9342c3792 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Deleted volume successfully. Nov 03 08:27:38 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4fbb85-4b6f-4f91-9659-a0cac89f2fe9]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1f027f3f-aed9-4f67-8b10-a9467580ad94 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e.f540f330-bd7b-4577-99f5-ce449b5d5f93 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-63424fad-2906-4be0-8ea8-a3b9342c3792 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-56deb0f3-78fa-468c-973a-6d77f95cd6fb-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:38 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e.f540f330-bd7b-4577-99f5-ce449b5d5f93 Nov 03 08:27:38 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:38 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1f027f3f-aed9-4f67-8b10-a9467580ad94 tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e.f540f330-bd7b-4577-99f5-ce449b5d5f93" returned: 0 in 0.631s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-1f027f3f-aed9-4f67-8b10-a9467580ad94 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4701475-36c7-40ec-8c07-5f13177ac46e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:27:38 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9bea05-5a0c-4370-9619-307e59f19e1c]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1f027f3f-aed9-4f67-8b10-a9467580ad94 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:39 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e Nov 03 08:27:39 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:39 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1f027f3f-aed9-4f67-8b10-a9467580ad94 tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e" returned: 0 in 0.641s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1f027f3f-aed9-4f67-8b10-a9467580ad94 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e.f540f330-bd7b-4577-99f5-ce449b5d5f93 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:39 devstack sudo[101547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e.f540f330-bd7b-4577-99f5-ce449b5d5f93 Nov 03 08:27:39 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:40 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1f027f3f-aed9-4f67-8b10-a9467580ad94 tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e.f540f330-bd7b-4577-99f5-ce449b5d5f93" returned: 0 in 0.598s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1f027f3f-aed9-4f67-8b10-a9467580ad94 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e.f540f330-bd7b-4577-99f5-ce449b5d5f93 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:40 devstack sudo[101554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e.f540f330-bd7b-4577-99f5-ce449b5d5f93 Nov 03 08:27:40 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:40 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1f027f3f-aed9-4f67-8b10-a9467580ad94 tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e.f540f330-bd7b-4577-99f5-ce449b5d5f93" returned: 0 in 0.341s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1f027f3f-aed9-4f67-8b10-a9467580ad94 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-quobyte-f540f330-bd7b-4577-99f5-ce449b5d5f93" released by "_delete_snapshot" :: held 2.449s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1f027f3f-aed9-4f67-8b10-a9467580ad94 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-quobyte-d4701475-36c7-40ec-8c07-5f13177ac46e" released by "delete_snapshot" :: held 2.492s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:40 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-1f027f3f-aed9-4f67-8b10-a9467580ad94 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Created reservations ['bfd8d95d-a41e-4a99-9b69-3e8331950a59', 'f576cfeb-d448-4878-a84d-5f6c6b81139f', '41f380b7-5971-4975-98da-ef6b90510e50', 'a2d75c8a-0572-4050-ade2-6eddd3f04d79'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:27:40 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-1f027f3f-aed9-4f67-8b10-a9467580ad94 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Delete snapshot completed successfully. Nov 03 08:27:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1f027f3f-aed9-4f67-8b10-a9467580ad94 tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-f540f330-bd7b-4577-99f5-ce449b5d5f93-delete_snapshot" released by "delete_snapshot" :: held 2.810s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:41 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-801ffeda-0a7a-4508-b158-9f22f82f277e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "cinder-d4701475-36c7-40ec-8c07-5f13177ac46e-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:41 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-801ffeda-0a7a-4508-b158-9f22f82f277e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-d4701475-36c7-40ec-8c07-5f13177ac46e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:41 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-801ffeda-0a7a-4508-b158-9f22f82f277e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "cinder-quobyte-d4701475-36c7-40ec-8c07-5f13177ac46e" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:41 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-801ffeda-0a7a-4508-b158-9f22f82f277e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-quobyte-d4701475-36c7-40ec-8c07-5f13177ac46e" acquired by "delete_volume" :: waited 0.031s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:41 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f95e61-2b9f-4350-869d-68ad1dac61dc]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-801ffeda-0a7a-4508-b158-9f22f82f277e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:41 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e Nov 03 08:27:41 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:42 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-801ffeda-0a7a-4508-b158-9f22f82f277e tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e" returned: 0 in 0.680s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-801ffeda-0a7a-4508-b158-9f22f82f277e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:42 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e Nov 03 08:27:42 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:42 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-801ffeda-0a7a-4508-b158-9f22f82f277e tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d4701475-36c7-40ec-8c07-5f13177ac46e" returned: 0 in 0.469s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-801ffeda-0a7a-4508-b158-9f22f82f277e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-quobyte-d4701475-36c7-40ec-8c07-5f13177ac46e" released by "delete_volume" :: held 1.296s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:42 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-801ffeda-0a7a-4508-b158-9f22f82f277e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Created reservations ['e07d6950-5355-4800-8437-d0bd14fc0706', '2c5cf7e3-8aec-43e6-9ce0-c1cfd3e86cc2', '133f088f-461e-4d54-9bd7-24825e3bffcb', 'f4b82528-69f4-45f3-bac8-878d70afb813'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:27:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-801ffeda-0a7a-4508-b158-9f22f82f277e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-801ffeda-0a7a-4508-b158-9f22f82f277e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:43 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-801ffeda-0a7a-4508-b158-9f22f82f277e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:43 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-801ffeda-0a7a-4508-b158-9f22f82f277e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-801ffeda-0a7a-4508-b158-9f22f82f277e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-801ffeda-0a7a-4508-b158-9f22f82f277e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:43 devstack sudo[101566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:27:43 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:43 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-801ffeda-0a7a-4508-b158-9f22f82f277e tempest-CreateVolumesFromSnapshotTest-1534897542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.509s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:43 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-801ffeda-0a7a-4508-b158-9f22f82f277e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:27:43 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-801ffeda-0a7a-4508-b158-9f22f82f277e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Deleted volume successfully. Nov 03 08:27:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-801ffeda-0a7a-4508-b158-9f22f82f277e tempest-CreateVolumesFromSnapshotTest-1534897542 None] Lock "cinder-d4701475-36c7-40ec-8c07-5f13177ac46e-delete_volume" released by "delete_volume" :: held 2.167s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:44 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4970a6a0-71be-452f-b218-7721debe031f" returned: 0 in 7.445s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:44 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec, size 1024.00 MB, duration 7.45 sec, destination /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4970a6a0-71be-452f-b218-7721debe031f {{(pid=86801) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 08:27:44 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Converted 1024.00 MB image at 137.51 MB/s Nov 03 08:27:44 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4970a6a0-71be-452f-b218-7721debe031f is being set with open permissions: ugo+rw Nov 03 08:27:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4970a6a0-71be-452f-b218-7721debe031f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:45 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4970a6a0-71be-452f-b218-7721debe031f Nov 03 08:27:45 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:45 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4970a6a0-71be-452f-b218-7721debe031f" returned: 0 in 0.286s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:45 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-4970a6a0-71be-452f-b218-7721debe031f" released by "_copy_volume_from_snapshot" :: held 8.682s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:45 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-4e4da53a-7c5b-4e87-be20-82155c1c8bee-4970a6a0-71be-452f-b218-7721debe031f" released by "_create_volume_from_snapshot" :: held 8.756s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.780s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754a0503-6027-41ae-9b28-33ff6ab14cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4970a6a0-71be-452f-b218-7721debe031f', 'volume_size': 1, 'snapshot_id': '4e4da53a-7c5b-4e87-be20-82155c1c8bee'}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd54cacd-63ca-4b18-8ceb-443bc60fa6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:45 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Volume volume-4970a6a0-71be-452f-b218-7721debe031f (4970a6a0-71be-452f-b218-7721debe031f): created successfully Nov 03 08:27:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd54cacd-63ca-4b18-8ceb-443bc60fa6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Flow 'volume_create_manager' (3fbc1e01-0605-424e-afa5-5ed51070e826) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:27:45 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-fa0f5c28-ba4f-4f5b-823c-ff727e601367 tempest-VolumesSnapshotTestJSON-571293391 None] Created volume successfully. Nov 03 08:27:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-b1f53ef4-d034-4daf-b89d-c23512267a9e req-5f68950f-6583-4d73-abaa-365abe167a67 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-b1f53ef4-d034-4daf-b89d-c23512267a9e req-5f68950f-6583-4d73-abaa-365abe167a67 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-b1f53ef4-d034-4daf-b89d-c23512267a9e req-5f68950f-6583-4d73-abaa-365abe167a67 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-b1f53ef4-d034-4daf-b89d-c23512267a9e req-5f68950f-6583-4d73-abaa-365abe167a67 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f', 'name': 'volume-e6d80a26-0d37-439b-9f89-d2dd4e401da6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e7b12ad5-5264-44a1-bf1b-1ccd9d85cf10', 'enforce_multipath': True} {{(pid=86801) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 08:27:46 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-b1f53ef4-d034-4daf-b89d-c23512267a9e req-5f68950f-6583-4d73-abaa-365abe167a67 tempest-TestServerVolumeAttachmentScenario-1708868464 None] attachment_update completed successfully. Nov 03 08:27:46 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-555064e4-196d-47fb-a6bf-770fdda971c3 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "cinder-4970a6a0-71be-452f-b218-7721debe031f-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:46 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-555064e4-196d-47fb-a6bf-770fdda971c3 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-4970a6a0-71be-452f-b218-7721debe031f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:46 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-555064e4-196d-47fb-a6bf-770fdda971c3 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "cinder-quobyte-4970a6a0-71be-452f-b218-7721debe031f" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:46 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-555064e4-196d-47fb-a6bf-770fdda971c3 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-4970a6a0-71be-452f-b218-7721debe031f" acquired by "delete_volume" :: waited 0.019s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:46 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb94b2f-ad48-4323-a353-bcac897e3ad2]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-555064e4-196d-47fb-a6bf-770fdda971c3 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4970a6a0-71be-452f-b218-7721debe031f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:46 devstack sudo[101686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4970a6a0-71be-452f-b218-7721debe031f Nov 03 08:27:46 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:46 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-555064e4-196d-47fb-a6bf-770fdda971c3 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4970a6a0-71be-452f-b218-7721debe031f" returned: 0 in 0.440s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-555064e4-196d-47fb-a6bf-770fdda971c3 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4970a6a0-71be-452f-b218-7721debe031f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:46 devstack sudo[102008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4970a6a0-71be-452f-b218-7721debe031f Nov 03 08:27:46 devstack sudo[102008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:47 devstack sudo[102008]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-555064e4-196d-47fb-a6bf-770fdda971c3 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-4970a6a0-71be-452f-b218-7721debe031f" returned: 0 in 0.248s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-555064e4-196d-47fb-a6bf-770fdda971c3 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-4970a6a0-71be-452f-b218-7721debe031f" released by "delete_volume" :: held 0.754s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-555064e4-196d-47fb-a6bf-770fdda971c3 tempest-VolumesSnapshotTestJSON-571293391 None] Created reservations ['92d5151f-3c67-46d8-9473-2736de91b4c8', 'd26f6283-78a3-4736-82cf-253868d3c267', 'eb7ffa8c-292a-4f58-b47e-f1f3086730ef', '4b3e2d2d-74fd-4a7a-9d90-7a3084e63bd8'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-555064e4-196d-47fb-a6bf-770fdda971c3 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-555064e4-196d-47fb-a6bf-770fdda971c3 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-555064e4-196d-47fb-a6bf-770fdda971c3 tempest-VolumesSnapshotTestJSON-571293391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-555064e4-196d-47fb-a6bf-770fdda971c3 tempest-VolumesSnapshotTestJSON-571293391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-555064e4-196d-47fb-a6bf-770fdda971c3 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-555064e4-196d-47fb-a6bf-770fdda971c3 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:47 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:27:47 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Flow 'volume_create_manager' (fef863bd-29ba-4223-9cd5-39be9ed4d6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:27:47 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31227c4-a894-4178-8f27-594a73c68c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-555064e4-196d-47fb-a6bf-770fdda971c3 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.271s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-555064e4-196d-47fb-a6bf-770fdda971c3 tempest-VolumesSnapshotTestJSON-571293391 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31227c4-a894-4178-8f27-594a73c68c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-778435884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6782e76-8001-4937-a2f3-35ddd153b353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22e93bff5bd1405c8f1535527890d8cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:27:47Z,use_quota=True,user_id='31cba4bc6ff7457aad3f7493ac014ecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90494be7-edc9-4f6d-80ea-6b58a9fcf7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90494be7-edc9-4f6d-80ea-6b58a9fcf7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (984ca696-cf17-4a9a-b875-15775963a819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (984ca696-cf17-4a9a-b875-15775963a819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6782e76-8001-4937-a2f3-35ddd153b353', 'volume_name': 'volume-b6782e76-8001-4937-a2f3-35ddd153b353', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0611a624-cca7-46bd-82cf-8fa31a4feebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0611a624-cca7-46bd-82cf-8fa31a4feebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8207cde4-7e36-4ad8-8de8-b4a0ef64f23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:47 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Volume b6782e76-8001-4937-a2f3-35ddd153b353: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6782e76-8001-4937-a2f3-35ddd153b353', 'volume_size': 1} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-778435884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6782e76-8001-4937-a2f3-35ddd153b353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22e93bff5bd1405c8f1535527890d8cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:27:47Z,use_quota=True,user_id='31cba4bc6ff7457aad3f7493ac014ecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Creating volume b6782e76-8001-4937-a2f3-35ddd153b353 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:27:47 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:47 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-555064e4-196d-47fb-a6bf-770fdda971c3 tempest-VolumesSnapshotTestJSON-571293391 None] Deleted volume successfully. Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b5a19cbf-0de2-4461-a425-39165bfc91ed tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "cinder-4e4da53a-7c5b-4e87-be20-82155c1c8bee-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:47 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353 1073741824 Nov 03 08:27:47 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-555064e4-196d-47fb-a6bf-770fdda971c3 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-4970a6a0-71be-452f-b218-7721debe031f-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b5a19cbf-0de2-4461-a425-39165bfc91ed tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-4e4da53a-7c5b-4e87-be20-82155c1c8bee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b5a19cbf-0de2-4461-a425-39165bfc91ed tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "cinder-quobyte-7ba48edd-b5ae-492a-a245-9377d4b28fec" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b5a19cbf-0de2-4461-a425-39165bfc91ed tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-7ba48edd-b5ae-492a-a245-9377d4b28fec" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b5a19cbf-0de2-4461-a425-39165bfc91ed tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "cinder-quobyte-4e4da53a-7c5b-4e87-be20-82155c1c8bee" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b5a19cbf-0de2-4461-a425-39165bfc91ed tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-4e4da53a-7c5b-4e87-be20-82155c1c8bee" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-b5a19cbf-0de2-4461-a425-39165bfc91ed tempest-VolumesSnapshotTestJSON-571293391 None] Deleting offline snapshot 4e4da53a-7c5b-4e87-be20-82155c1c8bee of volume 7ba48edd-b5ae-492a-a245-9377d4b28fec {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-b5a19cbf-0de2-4461-a425-39165bfc91ed tempest-VolumesSnapshotTestJSON-571293391 None] snapshot_file for this snap is: volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.4e4da53a-7c5b-4e87-be20-82155c1c8bee {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea16ace5-fee7-415b-a7f7-f96eff4cb54b]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b5a19cbf-0de2-4461-a425-39165bfc91ed tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.4e4da53a-7c5b-4e87-be20-82155c1c8bee {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:47 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.4e4da53a-7c5b-4e87-be20-82155c1c8bee Nov 03 08:27:47 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:48 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353 1073741824" returned: 0 in 0.475s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:48 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b5a19cbf-0de2-4461-a425-39165bfc91ed tempest-VolumesSnapshotTestJSON-571293391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.4e4da53a-7c5b-4e87-be20-82155c1c8bee" returned: 0 in 0.379s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-b5a19cbf-0de2-4461-a425-39165bfc91ed tempest-VolumesSnapshotTestJSON-571293391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ba48edd-b5ae-492a-a245-9377d4b28fec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:27:48 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5a507c-3071-4e00-a3a9-002870f9fab2]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b5a19cbf-0de2-4461-a425-39165bfc91ed tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:48 devstack sudo[102026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353 Nov 03 08:27:48 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:48 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec Nov 03 08:27:48 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:48 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353" returned: 0 in 0.302s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:27:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8207cde4-7e36-4ad8-8de8-b4a0ef64f23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6782e76-8001-4937-a2f3-35ddd153b353', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c549acc-cdbb-4652-a8af-6c4d31678329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:48 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Volume volume-b6782e76-8001-4937-a2f3-35ddd153b353 (b6782e76-8001-4937-a2f3-35ddd153b353): created successfully Nov 03 08:27:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c549acc-cdbb-4652-a8af-6c4d31678329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Flow 'volume_create_manager' (fef863bd-29ba-4223-9cd5-39be9ed4d6a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:27:48 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-43143041-3204-4a69-8063-768735980ed3 tempest-VolumeDependencyTests-160098306 None] Created volume successfully. Nov 03 08:27:48 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b5a19cbf-0de2-4461-a425-39165bfc91ed tempest-VolumesSnapshotTestJSON-571293391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec" returned: 0 in 0.582s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b5a19cbf-0de2-4461-a425-39165bfc91ed tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.4e4da53a-7c5b-4e87-be20-82155c1c8bee {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:48 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.4e4da53a-7c5b-4e87-be20-82155c1c8bee Nov 03 08:27:48 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:49 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b5a19cbf-0de2-4461-a425-39165bfc91ed tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.4e4da53a-7c5b-4e87-be20-82155c1c8bee" returned: 0 in 0.321s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b5a19cbf-0de2-4461-a425-39165bfc91ed tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.4e4da53a-7c5b-4e87-be20-82155c1c8bee {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:49 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.4e4da53a-7c5b-4e87-be20-82155c1c8bee Nov 03 08:27:49 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:49 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b5a19cbf-0de2-4461-a425-39165bfc91ed tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec.4e4da53a-7c5b-4e87-be20-82155c1c8bee" returned: 0 in 0.263s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:49 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b5a19cbf-0de2-4461-a425-39165bfc91ed tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-4e4da53a-7c5b-4e87-be20-82155c1c8bee" released by "_delete_snapshot" :: held 1.655s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:49 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b5a19cbf-0de2-4461-a425-39165bfc91ed tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-7ba48edd-b5ae-492a-a245-9377d4b28fec" released by "delete_snapshot" :: held 1.681s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:49 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-b5a19cbf-0de2-4461-a425-39165bfc91ed tempest-VolumesSnapshotTestJSON-571293391 None] Created reservations ['8f95f3f7-5c00-4cad-9dc2-a1b81a9f5a5f', 'dccc5f32-6e32-49a5-a4a7-3bff3341fec1', '483971f7-5475-4785-8000-eeab735acdc7', 'f809d1d0-e341-49fd-923b-8df41603b432'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:27:49 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-b5a19cbf-0de2-4461-a425-39165bfc91ed tempest-VolumesSnapshotTestJSON-571293391 None] Delete snapshot completed successfully. Nov 03 08:27:49 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b5a19cbf-0de2-4461-a425-39165bfc91ed tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-4e4da53a-7c5b-4e87-be20-82155c1c8bee-delete_snapshot" released by "delete_snapshot" :: held 1.824s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f2604b84-c8db-4b1c-8588-097279b6d27c tempest-VolumeDependencyTests-160098306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f2604b84-c8db-4b1c-8588-097279b6d27c tempest-VolumeDependencyTests-160098306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:49 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-f2604b84-c8db-4b1c-8588-097279b6d27c tempest-VolumeDependencyTests-160098306 None] Creating offline snapshot f5c60b1f-bf24-4fea-aab1-72b64cef3dc1 of volume b6782e76-8001-4937-a2f3-35ddd153b353 {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:27:49 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fc9b2f-14c4-4741-a558-16ece16a878d]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f2604b84-c8db-4b1c-8588-097279b6d27c tempest-VolumeDependencyTests-160098306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:49 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-59439bae-5b32-44b4-8033-6ece02ffad89 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "cinder-7ba48edd-b5ae-492a-a245-9377d4b28fec-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:49 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-59439bae-5b32-44b4-8033-6ece02ffad89 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-7ba48edd-b5ae-492a-a245-9377d4b28fec-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:49 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-59439bae-5b32-44b4-8033-6ece02ffad89 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "cinder-quobyte-7ba48edd-b5ae-492a-a245-9377d4b28fec" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:49 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-59439bae-5b32-44b4-8033-6ece02ffad89 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-7ba48edd-b5ae-492a-a245-9377d4b28fec" acquired by "delete_volume" :: waited 0.017s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:50 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353 Nov 03 08:27:50 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:50 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f64b40c-816a-4596-a870-b745065d2ffd]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-59439bae-5b32-44b4-8033-6ece02ffad89 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:50 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec Nov 03 08:27:50 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:50 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f2604b84-c8db-4b1c-8588-097279b6d27c tempest-VolumeDependencyTests-160098306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353" returned: 0 in 0.418s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f2604b84-c8db-4b1c-8588-097279b6d27c tempest-VolumeDependencyTests-160098306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.f5c60b1f-bf24-4fea-aab1-72b64cef3dc1 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:50 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.f5c60b1f-bf24-4fea-aab1-72b64cef3dc1 1G Nov 03 08:27:50 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:50 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-59439bae-5b32-44b4-8033-6ece02ffad89 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec" returned: 0 in 0.413s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-59439bae-5b32-44b4-8033-6ece02ffad89 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:50 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec Nov 03 08:27:50 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:50 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-59439bae-5b32-44b4-8033-6ece02ffad89 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ba48edd-b5ae-492a-a245-9377d4b28fec" returned: 0 in 0.289s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:50 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-59439bae-5b32-44b4-8033-6ece02ffad89 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-7ba48edd-b5ae-492a-a245-9377d4b28fec" released by "delete_volume" :: held 0.767s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:50 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f2604b84-c8db-4b1c-8588-097279b6d27c tempest-VolumeDependencyTests-160098306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.f5c60b1f-bf24-4fea-aab1-72b64cef3dc1 1G" returned: 0 in 0.518s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f2604b84-c8db-4b1c-8588-097279b6d27c tempest-VolumeDependencyTests-160098306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6782e76-8001-4937-a2f3-35ddd153b353 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.f5c60b1f-bf24-4fea-aab1-72b64cef3dc1 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:50 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-59439bae-5b32-44b4-8033-6ece02ffad89 tempest-VolumesSnapshotTestJSON-571293391 None] Created reservations ['9ca6be7c-cb1d-487a-a087-125c9114895c', 'd703b730-863d-4c84-8dfd-02a8b2876894', '99f18554-d50f-4a0c-a045-0a122ca29528', '848ff58e-47a3-4e14-9a17-4152f2113f8a'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:27:50 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6782e76-8001-4937-a2f3-35ddd153b353 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.f5c60b1f-bf24-4fea-aab1-72b64cef3dc1 Nov 03 08:27:50 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-59439bae-5b32-44b4-8033-6ece02ffad89 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-59439bae-5b32-44b4-8033-6ece02ffad89 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:50 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-59439bae-5b32-44b4-8033-6ece02ffad89 tempest-VolumesSnapshotTestJSON-571293391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:50 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-59439bae-5b32-44b4-8033-6ece02ffad89 tempest-VolumesSnapshotTestJSON-571293391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-59439bae-5b32-44b4-8033-6ece02ffad89 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-59439bae-5b32-44b4-8033-6ece02ffad89 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:50 devstack sudo[102071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:27:50 devstack sudo[102071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-7be50f3e-9483-4c89-8f08-e7936582bfaf req-5d3876c9-6aae-435b-965e-6257ebe43181 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:51 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8a529286-c45c-4265-b9d8-221b813eff93 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "cinder-3591e80e-b7f4-43f1-b626-b0db9524d5dc-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:51 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8a529286-c45c-4265-b9d8-221b813eff93 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-3591e80e-b7f4-43f1-b626-b0db9524d5dc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:51 devstack sudo[102071]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-59439bae-5b32-44b4-8033-6ece02ffad89 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.283s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:51 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-59439bae-5b32-44b4-8033-6ece02ffad89 tempest-VolumesSnapshotTestJSON-571293391 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:27:51 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-59439bae-5b32-44b4-8033-6ece02ffad89 tempest-VolumesSnapshotTestJSON-571293391 None] Deleted volume successfully. Nov 03 08:27:51 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8a529286-c45c-4265-b9d8-221b813eff93 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "cinder-quobyte-3591e80e-b7f4-43f1-b626-b0db9524d5dc" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:51 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f2604b84-c8db-4b1c-8588-097279b6d27c tempest-VolumeDependencyTests-160098306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6782e76-8001-4937-a2f3-35ddd153b353 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.f5c60b1f-bf24-4fea-aab1-72b64cef3dc1" returned: 0 in 0.426s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:51 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-f2604b84-c8db-4b1c-8588-097279b6d27c tempest-VolumeDependencyTests-160098306 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.f5c60b1f-bf24-4fea-aab1-72b64cef3dc1 is being set with open permissions: ugo+rw Nov 03 08:27:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f2604b84-c8db-4b1c-8588-097279b6d27c tempest-VolumeDependencyTests-160098306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.f5c60b1f-bf24-4fea-aab1-72b64cef3dc1 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:51 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8a529286-c45c-4265-b9d8-221b813eff93 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-3591e80e-b7f4-43f1-b626-b0db9524d5dc" acquired by "delete_volume" :: waited 0.039s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:51 devstack sudo[102079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.f5c60b1f-bf24-4fea-aab1-72b64cef3dc1 Nov 03 08:27:51 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:51 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-59439bae-5b32-44b4-8033-6ece02ffad89 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-7ba48edd-b5ae-492a-a245-9377d4b28fec-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:51 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[517a0e12-df66-4ce8-90de-a7d8840418ea]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8a529286-c45c-4265-b9d8-221b813eff93 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:51 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc Nov 03 08:27:51 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:51 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f2604b84-c8db-4b1c-8588-097279b6d27c tempest-VolumeDependencyTests-160098306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.f5c60b1f-bf24-4fea-aab1-72b64cef3dc1" returned: 0 in 0.262s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f2604b84-c8db-4b1c-8588-097279b6d27c tempest-VolumeDependencyTests-160098306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:51 devstack sudo[102084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.info Nov 03 08:27:51 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:51 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8a529286-c45c-4265-b9d8-221b813eff93 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc" returned: 0 in 0.368s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8a529286-c45c-4265-b9d8-221b813eff93 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:51 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc Nov 03 08:27:51 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:51 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f2604b84-c8db-4b1c-8588-097279b6d27c tempest-VolumeDependencyTests-160098306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.info" returned: 0 in 0.268s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:51 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-f2604b84-c8db-4b1c-8588-097279b6d27c tempest-VolumeDependencyTests-160098306 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.info is being set with open permissions: ugo+rw Nov 03 08:27:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f2604b84-c8db-4b1c-8588-097279b6d27c tempest-VolumeDependencyTests-160098306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:51 devstack sudo[102092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.info Nov 03 08:27:51 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:51 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8a529286-c45c-4265-b9d8-221b813eff93 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3591e80e-b7f4-43f1-b626-b0db9524d5dc" returned: 0 in 0.273s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:51 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8a529286-c45c-4265-b9d8-221b813eff93 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-quobyte-3591e80e-b7f4-43f1-b626-b0db9524d5dc" released by "delete_volume" :: held 0.718s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:52 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-8a529286-c45c-4265-b9d8-221b813eff93 tempest-VolumesSnapshotTestJSON-571293391 None] Created reservations ['03780c39-3528-4a73-acd9-081b585bd034', 'e26b6def-05d7-44cf-81fd-024f5f7cc66d', 'e12d64a1-1a97-426e-89bf-99cd25e5d3ae', '7f338a50-b535-44c9-adb7-d5b05a63c6c2'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:27:52 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f2604b84-c8db-4b1c-8588-097279b6d27c tempest-VolumeDependencyTests-160098306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.info" returned: 0 in 0.259s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f2604b84-c8db-4b1c-8588-097279b6d27c tempest-VolumeDependencyTests-160098306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.247s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-7be50f3e-9483-4c89-8f08-e7936582bfaf req-5d3876c9-6aae-435b-965e-6257ebe43181 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.942s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-7be50f3e-9483-4c89-8f08-e7936582bfaf req-5d3876c9-6aae-435b-965e-6257ebe43181 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8a529286-c45c-4265-b9d8-221b813eff93 tempest-VolumesSnapshotTestJSON-571293391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8a529286-c45c-4265-b9d8-221b813eff93 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:52 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8a529286-c45c-4265-b9d8-221b813eff93 tempest-VolumesSnapshotTestJSON-571293391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:52 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8a529286-c45c-4265-b9d8-221b813eff93 tempest-VolumesSnapshotTestJSON-571293391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8a529286-c45c-4265-b9d8-221b813eff93 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8a529286-c45c-4265-b9d8-221b813eff93 tempest-VolumesSnapshotTestJSON-571293391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:52 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-f2604b84-c8db-4b1c-8588-097279b6d27c tempest-VolumeDependencyTests-160098306 None] Create snapshot completed successfully Nov 03 08:27:52 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:27:52 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-7be50f3e-9483-4c89-8f08-e7936582bfaf req-5d3876c9-6aae-435b-965e-6257ebe43181 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f', 'name': 'volume-acb50b83-119b-4030-8d10-ff4796fa8ce5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc7fa77c-fef1-4e43-90ee-83525d6023a0', 'enforce_multipath': True} {{(pid=86801) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 08:27:52 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-7be50f3e-9483-4c89-8f08-e7936582bfaf req-5d3876c9-6aae-435b-965e-6257ebe43181 tempest-TestServerVolumeAttachmentScenario-1708868464 None] attachment_update completed successfully. Nov 03 08:27:52 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8a529286-c45c-4265-b9d8-221b813eff93 tempest-VolumesSnapshotTestJSON-571293391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.268s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:52 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-8a529286-c45c-4265-b9d8-221b813eff93 tempest-VolumesSnapshotTestJSON-571293391 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:27:52 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-8a529286-c45c-4265-b9d8-221b813eff93 tempest-VolumesSnapshotTestJSON-571293391 None] Deleted volume successfully. Nov 03 08:27:52 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8a529286-c45c-4265-b9d8-221b813eff93 tempest-VolumesSnapshotTestJSON-571293391 None] Lock "cinder-3591e80e-b7f4-43f1-b626-b0db9524d5dc-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Flow 'volume_create_manager' (488b66a0-c4dc-4a0c-a7d7-095136a1d4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3011334-40a8-4bb5-974d-edd1cf0d4b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3011334-40a8-4bb5-974d-edd1cf0d4b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1113915401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=143cd2d7-9595-42f9-ac1c-47be9576f3f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22e93bff5bd1405c8f1535527890d8cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f5c60b1f-bf24-4fea-aab1-72b64cef3dc1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:27:54Z,use_quota=True,user_id='31cba4bc6ff7457aad3f7493ac014ecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4c5d30-9238-4abe-8d4c-8e5932c0881c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4c5d30-9238-4abe-8d4c-8e5932c0881c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc84c826-d846-4680-bc39-658b9f6b1db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc84c826-d846-4680-bc39-658b9f6b1db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '143cd2d7-9595-42f9-ac1c-47be9576f3f8', 'volume_name': 'volume-143cd2d7-9595-42f9-ac1c-47be9576f3f8', 'volume_size': 1, 'snapshot_id': 'f5c60b1f-bf24-4fea-aab1-72b64cef3dc1'}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b88fd3a7-d860-4ced-9a9d-d20d4cd6afab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b88fd3a7-d860-4ced-9a9d-d20d4cd6afab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c49fb72-c71e-4277-8c74-9278ab6c46ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:27:53 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Volume 143cd2d7-9595-42f9-ac1c-47be9576f3f8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-143cd2d7-9595-42f9-ac1c-47be9576f3f8', 'volume_size': 1, 'snapshot_id': 'f5c60b1f-bf24-4fea-aab1-72b64cef3dc1'} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Acquiring lock "cinder-quobyte-f5c60b1f-bf24-4fea-aab1-72b64cef3dc1-143cd2d7-9595-42f9-ac1c-47be9576f3f8" by "_create_volume_from_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Lock "cinder-quobyte-f5c60b1f-bf24-4fea-aab1-72b64cef3dc1-143cd2d7-9595-42f9-ac1c-47be9576f3f8" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Creating volume 143cd2d7-9595-42f9-ac1c-47be9576f3f8 from snapshot f5c60b1f-bf24-4fea-aab1-72b64cef3dc1 {{(pid=86801) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Acquiring lock "cinder-quobyte-143cd2d7-9595-42f9-ac1c-47be9576f3f8" by "_copy_volume_from_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Lock "cinder-quobyte-143cd2d7-9595-42f9-ac1c-47be9576f3f8" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] snapshot: f5c60b1f-bf24-4fea-aab1-72b64cef3dc1, volume: 143cd2d7-9595-42f9-ac1c-47be9576f3f8, {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aed8b2f-184c-4a7a-ac05-2e9fee6db911]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.f5c60b1f-bf24-4fea-aab1-72b64cef3dc1 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:53 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-dfe9fa8d-b3ab-489a-a748-86ddb57d78ba req-a29e268e-d9f4-4869-9dba-789d1b26a741 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Terminate volume connection completed successfully. Nov 03 08:27:53 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-dfe9fa8d-b3ab-489a-a748-86ddb57d78ba req-a29e268e-d9f4-4869-9dba-789d1b26a741 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Deleting attachment dc7fa77c-fef1-4e43-90ee-83525d6023a0. {{(pid=86801) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 08:27:54 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.f5c60b1f-bf24-4fea-aab1-72b64cef3dc1 Nov 03 08:27:54 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:54 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.f5c60b1f-bf24-4fea-aab1-72b64cef3dc1" returned: 0 in 0.423s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6782e76-8001-4937-a2f3-35ddd153b353(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:27:54 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b46900d-0be0-459f-b15c-28597795727d]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:27:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:54 devstack sudo[102110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353 Nov 03 08:27:54 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:54 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root Nov 03 08:27:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353" returned: 0 in 0.394s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:27:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353 {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 08:27:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Creating direct copy from snapshot {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 08:27:54 devstack cinder-volume[86801]: DEBUG cinder.utils [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Path /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-143cd2d7-9595-42f9-ac1c-47be9576f3f8 not found in is_blk_device check {{(pid=86801) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 08:27:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-143cd2d7-9595-42f9-ac1c-47be9576f3f8 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:27:54 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-143cd2d7-9595-42f9-ac1c-47be9576f3f8 Nov 03 08:27:54 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:27:55 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-e1b77235-b277-4e6f-830a-64a24ad32fc0 req-d66bb23b-f9d5-4386-9fb6-833ff3fd12fb tempest-TestServerVolumeAttachmentScenario-1708868464 None] Terminate volume connection completed successfully. Nov 03 08:27:55 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-e1b77235-b277-4e6f-830a-64a24ad32fc0 req-d66bb23b-f9d5-4386-9fb6-833ff3fd12fb tempest-TestServerVolumeAttachmentScenario-1708868464 None] Deleting attachment e7b12ad5-5264-44a1-bf1b-1ccd9d85cf10. {{(pid=86801) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 08:28:03 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-143cd2d7-9595-42f9-ac1c-47be9576f3f8" returned: 0 in 8.954s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:03 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353, size 1024.00 MB, duration 8.95 sec, destination /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-143cd2d7-9595-42f9-ac1c-47be9576f3f8 {{(pid=86801) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 08:28:03 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Converted 1024.00 MB image at 114.35 MB/s Nov 03 08:28:03 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-143cd2d7-9595-42f9-ac1c-47be9576f3f8 is being set with open permissions: ugo+rw Nov 03 08:28:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-143cd2d7-9595-42f9-ac1c-47be9576f3f8 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:03 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager._thread_info {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:28:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread count: 29 {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 08:28:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread info: [<_MainThread(MainThread, started 139707544170624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 08:28:03 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-143cd2d7-9595-42f9-ac1c-47be9576f3f8 Nov 03 08:28:03 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6115dcd3-1c74-4697-9f50-d7d942a72b48 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Acquiring lock "cinder-acb50b83-119b-4030-8d10-ff4796fa8ce5-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:28:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6115dcd3-1c74-4697-9f50-d7d942a72b48 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Lock "cinder-acb50b83-119b-4030-8d10-ff4796fa8ce5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:28:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6115dcd3-1c74-4697-9f50-d7d942a72b48 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Acquiring lock "cinder-quobyte-acb50b83-119b-4030-8d10-ff4796fa8ce5" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:28:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6115dcd3-1c74-4697-9f50-d7d942a72b48 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Lock "cinder-quobyte-acb50b83-119b-4030-8d10-ff4796fa8ce5" acquired by "delete_volume" :: waited 0.016s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:28:03 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa00f3e5-f8e5-430f-b415-862a6e31d67c]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:28:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6115dcd3-1c74-4697-9f50-d7d942a72b48 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-acb50b83-119b-4030-8d10-ff4796fa8ce5 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:03 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-143cd2d7-9595-42f9-ac1c-47be9576f3f8" returned: 0 in 0.292s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Lock "cinder-quobyte-143cd2d7-9595-42f9-ac1c-47be9576f3f8" released by "_copy_volume_from_snapshot" :: held 10.164s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:28:04 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-acb50b83-119b-4030-8d10-ff4796fa8ce5 Nov 03 08:28:04 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Lock "cinder-quobyte-f5c60b1f-bf24-4fea-aab1-72b64cef3dc1-143cd2d7-9595-42f9-ac1c-47be9576f3f8" released by "_create_volume_from_snapshot" :: held 10.245s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:28:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.260s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:28:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c49fb72-c71e-4277-8c74-9278ab6c46ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-143cd2d7-9595-42f9-ac1c-47be9576f3f8', 'volume_size': 1, 'snapshot_id': 'f5c60b1f-bf24-4fea-aab1-72b64cef3dc1'}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c07d96f-dc0e-4e45-8153-5a8fb23c1f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:04 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Volume volume-143cd2d7-9595-42f9-ac1c-47be9576f3f8 (143cd2d7-9595-42f9-ac1c-47be9576f3f8): created successfully Nov 03 08:28:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c07d96f-dc0e-4e45-8153-5a8fb23c1f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Flow 'volume_create_manager' (488b66a0-c4dc-4a0c-a7d7-095136a1d4e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:28:04 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-f94afd7b-6390-46b1-b806-6f2e0d7d5672 tempest-VolumeDependencyTests-160098306 None] Created volume successfully. Nov 03 08:28:04 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6115dcd3-1c74-4697-9f50-d7d942a72b48 tempest-TestServerVolumeAttachmentScenario-1708868464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-acb50b83-119b-4030-8d10-ff4796fa8ce5" returned: 0 in 0.421s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6115dcd3-1c74-4697-9f50-d7d942a72b48 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-acb50b83-119b-4030-8d10-ff4796fa8ce5 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:04 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-acb50b83-119b-4030-8d10-ff4796fa8ce5 Nov 03 08:28:04 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:04 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6115dcd3-1c74-4697-9f50-d7d942a72b48 tempest-TestServerVolumeAttachmentScenario-1708868464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-acb50b83-119b-4030-8d10-ff4796fa8ce5" returned: 0 in 0.255s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6115dcd3-1c74-4697-9f50-d7d942a72b48 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Lock "cinder-quobyte-acb50b83-119b-4030-8d10-ff4796fa8ce5" released by "delete_volume" :: held 0.730s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:28:04 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-6115dcd3-1c74-4697-9f50-d7d942a72b48 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Created reservations ['445c8e05-eadf-4314-a24c-badee9ed6829', 'b782af4f-aa4a-482f-acba-3c750dc1eb85', 'c1874a3d-247e-4d79-b3ca-04407a808806', 'e03251ea-fff3-42ea-b77e-52d36afd1238'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:28:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6115dcd3-1c74-4697-9f50-d7d942a72b48 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:28:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6115dcd3-1c74-4697-9f50-d7d942a72b48 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:28:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6115dcd3-1c74-4697-9f50-d7d942a72b48 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:28:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6115dcd3-1c74-4697-9f50-d7d942a72b48 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:28:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6115dcd3-1c74-4697-9f50-d7d942a72b48 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:28:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6115dcd3-1c74-4697-9f50-d7d942a72b48 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:04 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:28:04 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-34275958-424f-4df8-b8ad-917c5edee7c3 tempest-VolumeDependencyTests-160098306 None] Acquiring lock "cinder-f5c60b1f-bf24-4fea-aab1-72b64cef3dc1-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:28:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-34275958-424f-4df8-b8ad-917c5edee7c3 tempest-VolumeDependencyTests-160098306 None] Lock "cinder-f5c60b1f-bf24-4fea-aab1-72b64cef3dc1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:28:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-34275958-424f-4df8-b8ad-917c5edee7c3 tempest-VolumeDependencyTests-160098306 None] Acquiring lock "cinder-quobyte-b6782e76-8001-4937-a2f3-35ddd153b353" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:28:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-34275958-424f-4df8-b8ad-917c5edee7c3 tempest-VolumeDependencyTests-160098306 None] Lock "cinder-quobyte-b6782e76-8001-4937-a2f3-35ddd153b353" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:28:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-34275958-424f-4df8-b8ad-917c5edee7c3 tempest-VolumeDependencyTests-160098306 None] Acquiring lock "cinder-quobyte-f5c60b1f-bf24-4fea-aab1-72b64cef3dc1" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:28:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-34275958-424f-4df8-b8ad-917c5edee7c3 tempest-VolumeDependencyTests-160098306 None] Lock "cinder-quobyte-f5c60b1f-bf24-4fea-aab1-72b64cef3dc1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:28:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-34275958-424f-4df8-b8ad-917c5edee7c3 tempest-VolumeDependencyTests-160098306 None] Deleting offline snapshot f5c60b1f-bf24-4fea-aab1-72b64cef3dc1 of volume b6782e76-8001-4937-a2f3-35ddd153b353 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:28:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-34275958-424f-4df8-b8ad-917c5edee7c3 tempest-VolumeDependencyTests-160098306 None] snapshot_file for this snap is: volume-b6782e76-8001-4937-a2f3-35ddd153b353.f5c60b1f-bf24-4fea-aab1-72b64cef3dc1 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:28:05 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d81da71-ebcc-4eb5-a152-b94292847992]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:28:05 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-34275958-424f-4df8-b8ad-917c5edee7c3 tempest-VolumeDependencyTests-160098306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.f5c60b1f-bf24-4fea-aab1-72b64cef3dc1 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9c1d5239-d469-4815-9d5f-85d529fa288c tempest-TestServerVolumeAttachmentScenario-1708868464 None] Acquiring lock "cinder-e6d80a26-0d37-439b-9f89-d2dd4e401da6-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:28:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6115dcd3-1c74-4697-9f50-d7d942a72b48 tempest-TestServerVolumeAttachmentScenario-1708868464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.325s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:05 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-6115dcd3-1c74-4697-9f50-d7d942a72b48 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:28:05 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-6115dcd3-1c74-4697-9f50-d7d942a72b48 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Deleted volume successfully. Nov 03 08:28:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9c1d5239-d469-4815-9d5f-85d529fa288c tempest-TestServerVolumeAttachmentScenario-1708868464 None] Lock "cinder-e6d80a26-0d37-439b-9f89-d2dd4e401da6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:28:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6115dcd3-1c74-4697-9f50-d7d942a72b48 tempest-TestServerVolumeAttachmentScenario-1708868464 None] Lock "cinder-acb50b83-119b-4030-8d10-ff4796fa8ce5-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:28:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9c1d5239-d469-4815-9d5f-85d529fa288c tempest-TestServerVolumeAttachmentScenario-1708868464 None] Acquiring lock "cinder-quobyte-e6d80a26-0d37-439b-9f89-d2dd4e401da6" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:28:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9c1d5239-d469-4815-9d5f-85d529fa288c tempest-TestServerVolumeAttachmentScenario-1708868464 None] Lock "cinder-quobyte-e6d80a26-0d37-439b-9f89-d2dd4e401da6" acquired by "delete_volume" :: waited 0.020s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:28:05 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.f5c60b1f-bf24-4fea-aab1-72b64cef3dc1 Nov 03 08:28:05 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:05 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[63be5035-eee1-4087-b3e8-235c6046c667]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:28:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9c1d5239-d469-4815-9d5f-85d529fa288c tempest-TestServerVolumeAttachmentScenario-1708868464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e6d80a26-0d37-439b-9f89-d2dd4e401da6 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:05 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e6d80a26-0d37-439b-9f89-d2dd4e401da6 Nov 03 08:28:05 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:05 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-34275958-424f-4df8-b8ad-917c5edee7c3 tempest-VolumeDependencyTests-160098306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.f5c60b1f-bf24-4fea-aab1-72b64cef3dc1" returned: 0 in 0.438s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:05 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-34275958-424f-4df8-b8ad-917c5edee7c3 tempest-VolumeDependencyTests-160098306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6782e76-8001-4937-a2f3-35ddd153b353(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:28:05 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e78316-eed2-4a5a-9362-82122ad2a372]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:28:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-34275958-424f-4df8-b8ad-917c5edee7c3 tempest-VolumeDependencyTests-160098306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:05 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353 Nov 03 08:28:05 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:05 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9c1d5239-d469-4815-9d5f-85d529fa288c tempest-TestServerVolumeAttachmentScenario-1708868464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e6d80a26-0d37-439b-9f89-d2dd4e401da6" returned: 0 in 0.442s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9c1d5239-d469-4815-9d5f-85d529fa288c tempest-TestServerVolumeAttachmentScenario-1708868464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e6d80a26-0d37-439b-9f89-d2dd4e401da6 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:05 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e6d80a26-0d37-439b-9f89-d2dd4e401da6 Nov 03 08:28:05 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:05 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9c1d5239-d469-4815-9d5f-85d529fa288c tempest-TestServerVolumeAttachmentScenario-1708868464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e6d80a26-0d37-439b-9f89-d2dd4e401da6" returned: 0 in 0.248s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9c1d5239-d469-4815-9d5f-85d529fa288c tempest-TestServerVolumeAttachmentScenario-1708868464 None] Lock "cinder-quobyte-e6d80a26-0d37-439b-9f89-d2dd4e401da6" released by "delete_volume" :: held 0.753s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:28:05 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-9c1d5239-d469-4815-9d5f-85d529fa288c tempest-TestServerVolumeAttachmentScenario-1708868464 None] Created reservations ['99532bc4-0dfb-4136-b074-dbeb5a6bf821', '2acf37b6-f34f-4b0c-a7d8-81acf4073997', '117b1879-3a38-4245-8c60-30d9501fc7f0', '4a9ea2f7-db5a-45aa-b60e-69c19315029c'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:28:06 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9c1d5239-d469-4815-9d5f-85d529fa288c tempest-TestServerVolumeAttachmentScenario-1708868464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:28:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9c1d5239-d469-4815-9d5f-85d529fa288c tempest-TestServerVolumeAttachmentScenario-1708868464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:28:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9c1d5239-d469-4815-9d5f-85d529fa288c tempest-TestServerVolumeAttachmentScenario-1708868464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:28:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9c1d5239-d469-4815-9d5f-85d529fa288c tempest-TestServerVolumeAttachmentScenario-1708868464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:28:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9c1d5239-d469-4815-9d5f-85d529fa288c tempest-TestServerVolumeAttachmentScenario-1708868464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:28:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9c1d5239-d469-4815-9d5f-85d529fa288c tempest-TestServerVolumeAttachmentScenario-1708868464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-34275958-424f-4df8-b8ad-917c5edee7c3 tempest-VolumeDependencyTests-160098306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353" returned: 0 in 0.609s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-34275958-424f-4df8-b8ad-917c5edee7c3 tempest-VolumeDependencyTests-160098306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.f5c60b1f-bf24-4fea-aab1-72b64cef3dc1 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:06 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:28:06 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:06 devstack sudo[102223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.f5c60b1f-bf24-4fea-aab1-72b64cef3dc1 Nov 03 08:28:06 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:06 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9c1d5239-d469-4815-9d5f-85d529fa288c tempest-TestServerVolumeAttachmentScenario-1708868464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.326s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:06 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-9c1d5239-d469-4815-9d5f-85d529fa288c tempest-TestServerVolumeAttachmentScenario-1708868464 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:28:06 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-9c1d5239-d469-4815-9d5f-85d529fa288c tempest-TestServerVolumeAttachmentScenario-1708868464 None] Deleted volume successfully. Nov 03 08:28:06 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9c1d5239-d469-4815-9d5f-85d529fa288c tempest-TestServerVolumeAttachmentScenario-1708868464 None] Lock "cinder-e6d80a26-0d37-439b-9f89-d2dd4e401da6-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:28:06 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-34275958-424f-4df8-b8ad-917c5edee7c3 tempest-VolumeDependencyTests-160098306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.f5c60b1f-bf24-4fea-aab1-72b64cef3dc1" returned: 0 in 0.444s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-34275958-424f-4df8-b8ad-917c5edee7c3 tempest-VolumeDependencyTests-160098306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.f5c60b1f-bf24-4fea-aab1-72b64cef3dc1 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:06 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.f5c60b1f-bf24-4fea-aab1-72b64cef3dc1 Nov 03 08:28:06 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:06 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-34275958-424f-4df8-b8ad-917c5edee7c3 tempest-VolumeDependencyTests-160098306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353.f5c60b1f-bf24-4fea-aab1-72b64cef3dc1" returned: 0 in 0.286s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:06 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-34275958-424f-4df8-b8ad-917c5edee7c3 tempest-VolumeDependencyTests-160098306 None] Lock "cinder-quobyte-f5c60b1f-bf24-4fea-aab1-72b64cef3dc1" released by "_delete_snapshot" :: held 1.955s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:28:06 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-34275958-424f-4df8-b8ad-917c5edee7c3 tempest-VolumeDependencyTests-160098306 None] Lock "cinder-quobyte-b6782e76-8001-4937-a2f3-35ddd153b353" released by "delete_snapshot" :: held 1.986s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:28:07 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-34275958-424f-4df8-b8ad-917c5edee7c3 tempest-VolumeDependencyTests-160098306 None] Created reservations ['9e6b30a8-f402-4644-8e55-b215ef4f141b', '18ef8cc5-2a8b-45ab-bbbd-5ce045dee447', '74179447-c3a5-4804-9972-1c773aa30ef7', 'ab9b9ff2-521e-440e-b8c6-4182b6c1e5e9'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:28:07 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-34275958-424f-4df8-b8ad-917c5edee7c3 tempest-VolumeDependencyTests-160098306 None] Delete snapshot completed successfully. Nov 03 08:28:07 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-34275958-424f-4df8-b8ad-917c5edee7c3 tempest-VolumeDependencyTests-160098306 None] Lock "cinder-f5c60b1f-bf24-4fea-aab1-72b64cef3dc1-delete_snapshot" released by "delete_snapshot" :: held 2.206s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:28:08 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d8bc30ec-85ff-4738-8efb-80f1e1e9d1c8 tempest-VolumeDependencyTests-160098306 None] Acquiring lock "cinder-b6782e76-8001-4937-a2f3-35ddd153b353-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:28:08 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d8bc30ec-85ff-4738-8efb-80f1e1e9d1c8 tempest-VolumeDependencyTests-160098306 None] Lock "cinder-b6782e76-8001-4937-a2f3-35ddd153b353-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:28:08 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d8bc30ec-85ff-4738-8efb-80f1e1e9d1c8 tempest-VolumeDependencyTests-160098306 None] Acquiring lock "cinder-quobyte-b6782e76-8001-4937-a2f3-35ddd153b353" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:28:08 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d8bc30ec-85ff-4738-8efb-80f1e1e9d1c8 tempest-VolumeDependencyTests-160098306 None] Lock "cinder-quobyte-b6782e76-8001-4937-a2f3-35ddd153b353" acquired by "delete_volume" :: waited 0.017s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:28:08 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[9983c1cc-0da8-47db-8485-371ec0d9329a]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:28:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d8bc30ec-85ff-4738-8efb-80f1e1e9d1c8 tempest-VolumeDependencyTests-160098306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:08 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353 Nov 03 08:28:08 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:08 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d8bc30ec-85ff-4738-8efb-80f1e1e9d1c8 tempest-VolumeDependencyTests-160098306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353" returned: 0 in 0.446s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d8bc30ec-85ff-4738-8efb-80f1e1e9d1c8 tempest-VolumeDependencyTests-160098306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:08 devstack sudo[102276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353 Nov 03 08:28:08 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:09 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d8bc30ec-85ff-4738-8efb-80f1e1e9d1c8 tempest-VolumeDependencyTests-160098306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b6782e76-8001-4937-a2f3-35ddd153b353" returned: 0 in 0.363s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:09 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d8bc30ec-85ff-4738-8efb-80f1e1e9d1c8 tempest-VolumeDependencyTests-160098306 None] Lock "cinder-quobyte-b6782e76-8001-4937-a2f3-35ddd153b353" released by "delete_volume" :: held 0.892s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:28:09 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-d8bc30ec-85ff-4738-8efb-80f1e1e9d1c8 tempest-VolumeDependencyTests-160098306 None] Created reservations ['5824c9b5-7eaa-49d5-a7e0-d67ad110a876', '087b8f09-4ae2-4b81-b258-bb446b741cce', '205bfe5e-87fc-49f7-835e-85b1620a913d', '2342008f-bf8a-4f0c-837d-61a00a4f7b1e'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:28:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d8bc30ec-85ff-4738-8efb-80f1e1e9d1c8 tempest-VolumeDependencyTests-160098306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:28:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d8bc30ec-85ff-4738-8efb-80f1e1e9d1c8 tempest-VolumeDependencyTests-160098306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:28:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d8bc30ec-85ff-4738-8efb-80f1e1e9d1c8 tempest-VolumeDependencyTests-160098306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:28:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d8bc30ec-85ff-4738-8efb-80f1e1e9d1c8 tempest-VolumeDependencyTests-160098306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:28:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d8bc30ec-85ff-4738-8efb-80f1e1e9d1c8 tempest-VolumeDependencyTests-160098306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:28:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d8bc30ec-85ff-4738-8efb-80f1e1e9d1c8 tempest-VolumeDependencyTests-160098306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:09 devstack sudo[102279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:28:09 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:09 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-35a21f5a-5fc0-4bc3-a4c4-dd299f4d8359 tempest-VolumeDependencyTests-160098306 None] Acquiring lock "cinder-143cd2d7-9595-42f9-ac1c-47be9576f3f8-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:28:09 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-35a21f5a-5fc0-4bc3-a4c4-dd299f4d8359 tempest-VolumeDependencyTests-160098306 None] Lock "cinder-143cd2d7-9595-42f9-ac1c-47be9576f3f8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:28:09 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-35a21f5a-5fc0-4bc3-a4c4-dd299f4d8359 tempest-VolumeDependencyTests-160098306 None] Acquiring lock "cinder-quobyte-143cd2d7-9595-42f9-ac1c-47be9576f3f8" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:28:09 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-35a21f5a-5fc0-4bc3-a4c4-dd299f4d8359 tempest-VolumeDependencyTests-160098306 None] Lock "cinder-quobyte-143cd2d7-9595-42f9-ac1c-47be9576f3f8" acquired by "delete_volume" :: waited 0.018s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:28:09 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b155aa-e849-4bb3-981b-8a2caca04193]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:28:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-35a21f5a-5fc0-4bc3-a4c4-dd299f4d8359 tempest-VolumeDependencyTests-160098306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-143cd2d7-9595-42f9-ac1c-47be9576f3f8 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:09 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d8bc30ec-85ff-4738-8efb-80f1e1e9d1c8 tempest-VolumeDependencyTests-160098306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.368s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:09 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-d8bc30ec-85ff-4738-8efb-80f1e1e9d1c8 tempest-VolumeDependencyTests-160098306 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:28:09 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-d8bc30ec-85ff-4738-8efb-80f1e1e9d1c8 tempest-VolumeDependencyTests-160098306 None] Deleted volume successfully. Nov 03 08:28:09 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-143cd2d7-9595-42f9-ac1c-47be9576f3f8 Nov 03 08:28:09 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:09 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d8bc30ec-85ff-4738-8efb-80f1e1e9d1c8 tempest-VolumeDependencyTests-160098306 None] Lock "cinder-b6782e76-8001-4937-a2f3-35ddd153b353-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:28:09 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-35a21f5a-5fc0-4bc3-a4c4-dd299f4d8359 tempest-VolumeDependencyTests-160098306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-143cd2d7-9595-42f9-ac1c-47be9576f3f8" returned: 0 in 0.398s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-35a21f5a-5fc0-4bc3-a4c4-dd299f4d8359 tempest-VolumeDependencyTests-160098306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-143cd2d7-9595-42f9-ac1c-47be9576f3f8 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:09 devstack sudo[102289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-143cd2d7-9595-42f9-ac1c-47be9576f3f8 Nov 03 08:28:09 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:10 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-35a21f5a-5fc0-4bc3-a4c4-dd299f4d8359 tempest-VolumeDependencyTests-160098306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-143cd2d7-9595-42f9-ac1c-47be9576f3f8" returned: 0 in 0.275s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:10 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-35a21f5a-5fc0-4bc3-a4c4-dd299f4d8359 tempest-VolumeDependencyTests-160098306 None] Lock "cinder-quobyte-143cd2d7-9595-42f9-ac1c-47be9576f3f8" released by "delete_volume" :: held 0.741s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:28:10 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-35a21f5a-5fc0-4bc3-a4c4-dd299f4d8359 tempest-VolumeDependencyTests-160098306 None] Created reservations ['b7168a65-01e7-4e48-a715-0308718184c2', '1dba933a-ccc3-4713-935e-f58a7990a74c', 'b948f657-ebed-461f-939d-94e876ad8e42', '7a9ee0a0-d147-42c6-ab4b-23abe5551b56'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:28:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-35a21f5a-5fc0-4bc3-a4c4-dd299f4d8359 tempest-VolumeDependencyTests-160098306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:28:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-35a21f5a-5fc0-4bc3-a4c4-dd299f4d8359 tempest-VolumeDependencyTests-160098306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:28:10 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-35a21f5a-5fc0-4bc3-a4c4-dd299f4d8359 tempest-VolumeDependencyTests-160098306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:28:10 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-35a21f5a-5fc0-4bc3-a4c4-dd299f4d8359 tempest-VolumeDependencyTests-160098306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:28:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-35a21f5a-5fc0-4bc3-a4c4-dd299f4d8359 tempest-VolumeDependencyTests-160098306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:28:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-35a21f5a-5fc0-4bc3-a4c4-dd299f4d8359 tempest-VolumeDependencyTests-160098306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:10 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:28:10 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:10 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-35a21f5a-5fc0-4bc3-a4c4-dd299f4d8359 tempest-VolumeDependencyTests-160098306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.345s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:10 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-35a21f5a-5fc0-4bc3-a4c4-dd299f4d8359 tempest-VolumeDependencyTests-160098306 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:28:10 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-35a21f5a-5fc0-4bc3-a4c4-dd299f4d8359 tempest-VolumeDependencyTests-160098306 None] Deleted volume successfully. Nov 03 08:28:10 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-35a21f5a-5fc0-4bc3-a4c4-dd299f4d8359 tempest-VolumeDependencyTests-160098306 None] Lock "cinder-143cd2d7-9595-42f9-ac1c-47be9576f3f8-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:28:20 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=119,cinder:INSERT=43,cinder:UPDATE=155,cinder:DELETE=9 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:28:20 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:UPDATE=161,cinder:DELETE=16,cinder:SELECT=130,cinder:INSERT=35 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:28:27 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Flow 'volume_create_manager' (b98b050a-ab1b-4f63-9dbc-83622c5e4666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38780491-f73f-4dbc-b89b-1d3b6e6d5ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38780491-f73f-4dbc-b89b-1d3b6e6d5ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-21356726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c922a71b-401d-40ca-a01e-95deff9d42c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52eb4bd5ed6f444e87ab1bae9db4dfc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:28:28Z,use_quota=True,user_id='1622ef86aba94e27bd3a9b2ac7af1fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35b29e5d-ba8f-4d5f-93e2-5520a204695b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35b29e5d-ba8f-4d5f-93e2-5520a204695b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bd9ba70-24d4-4c70-b4a6-47fc1a532bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bd9ba70-24d4-4c70-b4a6-47fc1a532bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c922a71b-401d-40ca-a01e-95deff9d42c8', 'volume_name': 'volume-c922a71b-401d-40ca-a01e-95deff9d42c8', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c77a701c-1d4e-4e3c-a6cc-2b25b677f669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c77a701c-1d4e-4e3c-a6cc-2b25b677f669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b80f0b3-530d-44d1-9c21-6d73b5b3c0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:28 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Volume c922a71b-401d-40ca-a01e-95deff9d42c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c922a71b-401d-40ca-a01e-95deff9d42c8', 'volume_size': 1} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-21356726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c922a71b-401d-40ca-a01e-95deff9d42c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52eb4bd5ed6f444e87ab1bae9db4dfc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:28:28Z,use_quota=True,user_id='1622ef86aba94e27bd3a9b2ac7af1fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Creating volume c922a71b-401d-40ca-a01e-95deff9d42c8 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:28:28 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c922a71b-401d-40ca-a01e-95deff9d42c8 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:28 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c922a71b-401d-40ca-a01e-95deff9d42c8 1073741824 Nov 03 08:28:28 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Flow 'volume_create_manager' (740203f4-fe56-4b24-b850-6efffcb80d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68bf22ae-a0f1-41ce-90a0-ddd05319a75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68bf22ae-a0f1-41ce-90a0-ddd05319a75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1688323134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f31846-5f73-4b91-bbc8-0595af258569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9438bfc869c3421f8468b3a5320181e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:28:28Z,use_quota=True,user_id='931a0e8be04c4854b245f4736b6537ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c34111d4-073a-4cc4-a0a1-01aca9905aa2),volume_type_id=c34111d4-073a-4cc4-a0a1-01aca9905aa2)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (890eed03-0798-4298-a3d1-f58eb6b83737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (890eed03-0798-4298-a3d1-f58eb6b83737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782ba7ea-47e0-4002-a0f2-1d88cb6dd803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782ba7ea-47e0-4002-a0f2-1d88cb6dd803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4f31846-5f73-4b91-bbc8-0595af258569', 'volume_name': 'volume-e4f31846-5f73-4b91-bbc8-0595af258569', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a85b513-c862-4cc0-865d-8e672016ff9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a85b513-c862-4cc0-865d-8e672016ff9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f46c3d4-761c-4201-a067-7fce9399dcc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:28 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Volume e4f31846-5f73-4b91-bbc8-0595af258569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4f31846-5f73-4b91-bbc8-0595af258569', 'volume_size': 1} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:28:28 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c922a71b-401d-40ca-a01e-95deff9d42c8 1073741824" returned: 0 in 0.541s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c922a71b-401d-40ca-a01e-95deff9d42c8 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:28 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c922a71b-401d-40ca-a01e-95deff9d42c8 Nov 03 08:28:28 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Flow 'volume_create_manager' (ea3ae59a-97d7-46f6-ae7c-26e964dd0b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fd836bd-8573-404c-9f59-8d5798b4f7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fd836bd-8573-404c-9f59-8d5798b4f7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2067067178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f5a597d-7edb-4539-9e31-f10f6a381fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9438bfc869c3421f8468b3a5320181e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:28:29Z,use_quota=True,user_id='931a0e8be04c4854b245f4736b6537ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ddfe8ae-b2d0-46f7-a255-be5c82071c3e),volume_type_id=1ddfe8ae-b2d0-46f7-a255-be5c82071c3e)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9cc152f-2cd4-4c9f-936c-e9eb12bc66ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9cc152f-2cd4-4c9f-936c-e9eb12bc66ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3233fd-6257-4be2-b1e6-9d1a1e8674c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3233fd-6257-4be2-b1e6-9d1a1e8674c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f5a597d-7edb-4539-9e31-f10f6a381fd7', 'volume_name': 'volume-2f5a597d-7edb-4539-9e31-f10f6a381fd7', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f2cd765-881b-4e59-bfe9-f234b7dfb2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f2cd765-881b-4e59-bfe9-f234b7dfb2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda30c70-aba6-47e6-b57b-66e5f46dbe20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:28 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Volume 2f5a597d-7edb-4539-9e31-f10f6a381fd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f5a597d-7edb-4539-9e31-f10f6a381fd7', 'volume_size': 1} Nov 03 08:28:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:28:29 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c922a71b-401d-40ca-a01e-95deff9d42c8" returned: 0 in 0.332s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.461s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1688323134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f31846-5f73-4b91-bbc8-0595af258569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9438bfc869c3421f8468b3a5320181e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:28:28Z,use_quota=True,user_id='931a0e8be04c4854b245f4736b6537ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c34111d4-073a-4cc4-a0a1-01aca9905aa2),volume_type_id=c34111d4-073a-4cc4-a0a1-01aca9905aa2)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Creating volume e4f31846-5f73-4b91-bbc8-0595af258569 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:28:29 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e4f31846-5f73-4b91-bbc8-0595af258569 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b80f0b3-530d-44d1-9c21-6d73b5b3c0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c922a71b-401d-40ca-a01e-95deff9d42c8', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:29 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e4f31846-5f73-4b91-bbc8-0595af258569 1073741824 Nov 03 08:28:29 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (212dd1c2-e283-419f-89d6-cbc4e2e291df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:29 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Volume volume-c922a71b-401d-40ca-a01e-95deff9d42c8 (c922a71b-401d-40ca-a01e-95deff9d42c8): created successfully Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (212dd1c2-e283-419f-89d6-cbc4e2e291df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Flow 'volume_create_manager' (b98b050a-ab1b-4f63-9dbc-83622c5e4666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:28:29 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-ff7053ee-c7c6-439e-828e-3cdfd16456f9 tempest-ProjectReaderTests-1815156674 None] Created volume successfully. Nov 03 08:28:29 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e4f31846-5f73-4b91-bbc8-0595af258569 1073741824" returned: 0 in 0.581s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Flow 'volume_create_manager' (6f0990ae-ed22-41d6-b251-4c748498a167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e95383-d1c4-46a9-b7a8-50224e21738f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e4f31846-5f73-4b91-bbc8-0595af258569 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e95383-d1c4-46a9-b7a8-50224e21738f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2080535736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f5909a9-8252-4da6-b393-c8ef910ec39d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9438bfc869c3421f8468b3a5320181e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:28:30Z,use_quota=True,user_id='931a0e8be04c4854b245f4736b6537ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b701cb4e-1a62-46b7-9074-2ac42b7ce899),volume_type_id=b701cb4e-1a62-46b7-9074-2ac42b7ce899)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:29 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e4f31846-5f73-4b91-bbc8-0595af258569 Nov 03 08:28:29 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d06e1efa-01ca-4ab5-b92b-5397d8e80258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d06e1efa-01ca-4ab5-b92b-5397d8e80258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0397ad1e-96ce-4dd9-be67-fa39d2a16df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG cinder.image.glance [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Creating Keystone auth plugin from conf {{(pid=86801) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 08:28:29 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e4f31846-5f73-4b91-bbc8-0595af258569" returned: 0 in 0.274s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.997s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2067067178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f5a597d-7edb-4539-9e31-f10f6a381fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9438bfc869c3421f8468b3a5320181e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:28:29Z,use_quota=True,user_id='931a0e8be04c4854b245f4736b6537ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ddfe8ae-b2d0-46f7-a255-be5c82071c3e),volume_type_id=1ddfe8ae-b2d0-46f7-a255-be5c82071c3e)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Creating volume 2f5a597d-7edb-4539-9e31-f10f6a381fd7 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:28:29 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:28:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2f5a597d-7edb-4539-9e31-f10f6a381fd7 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f46c3d4-761c-4201-a067-7fce9399dcc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4f31846-5f73-4b91-bbc8-0595af258569', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11eddf32-9f9d-4126-97c2-f9900aa07a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:30 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2f5a597d-7edb-4539-9e31-f10f6a381fd7 1073741824 Nov 03 08:28:30 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:30 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Volume volume-e4f31846-5f73-4b91-bbc8-0595af258569 (e4f31846-5f73-4b91-bbc8-0595af258569): created successfully Nov 03 08:28:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11eddf32-9f9d-4126-97c2-f9900aa07a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Flow 'volume_create_manager' (740203f4-fe56-4b24-b850-6efffcb80d45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:28:30 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-787f4777-f823-4e74-a5da-4ff01fc932af tempest-TestInstancesWithCinderVolumes-1629266108 None] Created volume successfully. Nov 03 08:28:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0397ad1e-96ce-4dd9-be67-fa39d2a16df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8f5909a9-8252-4da6-b393-c8ef910ec39d', 'volume_name': 'volume-8f5909a9-8252-4da6-b393-c8ef910ec39d', 'volume_size': 1, 'image_id': 'b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--63217776', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9438bfc869c3421f8468b3a5320181e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3', 'created_at': datetime.datetime(2026, 11, 3, 7, 28, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 28, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3/file', 'properties': {}}, 'image_service': }' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7168838-6040-4873-9bb8-f20c1b447684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7168838-6040-4873-9bb8-f20c1b447684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6541df73-6470-4402-943c-a79e87292742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:30 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Volume 8f5909a9-8252-4da6-b393-c8ef910ec39d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8f5909a9-8252-4da6-b393-c8ef910ec39d', 'volume_size': 1, 'image_id': 'b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--63217776', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9438bfc869c3421f8468b3a5320181e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3', 'created_at': datetime.datetime(2026, 11, 3, 7, 28, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 28, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3/file', 'properties': {}}, 'image_service': } Nov 03 08:28:30 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Trying to clone 8f5909a9-8252-4da6-b393-c8ef910ec39d from image b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3', 'metadata': {}}]). {{(pid=86801) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 08:28:30 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-dbfc2674-2901-4ea2-b2c1-d2a1b78afed2 tempest-ProjectReaderTests-1815156674 None] Acquiring lock "cinder-c922a71b-401d-40ca-a01e-95deff9d42c8-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:28:30 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-dbfc2674-2901-4ea2-b2c1-d2a1b78afed2 tempest-ProjectReaderTests-1815156674 None] Lock "cinder-c922a71b-401d-40ca-a01e-95deff9d42c8-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:28:30 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-dbfc2674-2901-4ea2-b2c1-d2a1b78afed2 tempest-ProjectReaderTests-1815156674 None] Acquiring lock "cinder-quobyte-c922a71b-401d-40ca-a01e-95deff9d42c8" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:28:30 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-dbfc2674-2901-4ea2-b2c1-d2a1b78afed2 tempest-ProjectReaderTests-1815156674 None] Lock "cinder-quobyte-c922a71b-401d-40ca-a01e-95deff9d42c8" acquired by "delete_volume" :: waited 0.024s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:28:30 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[05aaa228-d746-473b-9988-220da6d4cf97]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:28:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-dbfc2674-2901-4ea2-b2c1-d2a1b78afed2 tempest-ProjectReaderTests-1815156674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c922a71b-401d-40ca-a01e-95deff9d42c8 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:30 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2f5a597d-7edb-4539-9e31-f10f6a381fd7 1073741824" returned: 0 in 0.623s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:30 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c922a71b-401d-40ca-a01e-95deff9d42c8 Nov 03 08:28:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2f5a597d-7edb-4539-9e31-f10f6a381fd7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:30 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:30 devstack sudo[102326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2f5a597d-7edb-4539-9e31-f10f6a381fd7 Nov 03 08:28:30 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:31 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-dbfc2674-2901-4ea2-b2c1-d2a1b78afed2 tempest-ProjectReaderTests-1815156674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c922a71b-401d-40ca-a01e-95deff9d42c8" returned: 0 in 0.551s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-dbfc2674-2901-4ea2-b2c1-d2a1b78afed2 tempest-ProjectReaderTests-1815156674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c922a71b-401d-40ca-a01e-95deff9d42c8 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:31 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c922a71b-401d-40ca-a01e-95deff9d42c8 Nov 03 08:28:31 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:31 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2f5a597d-7edb-4539-9e31-f10f6a381fd7" returned: 0 in 0.473s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:28:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:28:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda30c70-aba6-47e6-b57b-66e5f46dbe20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f5a597d-7edb-4539-9e31-f10f6a381fd7', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0203f3a1-0d2a-4e71-b2b7-e787fcc31ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:31 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Volume volume-2f5a597d-7edb-4539-9e31-f10f6a381fd7 (2f5a597d-7edb-4539-9e31-f10f6a381fd7): created successfully Nov 03 08:28:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0203f3a1-0d2a-4e71-b2b7-e787fcc31ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Flow 'volume_create_manager' (ea3ae59a-97d7-46f6-ae7c-26e964dd0b04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:28:31 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-bf47fe62-d733-439f-b036-f8a9258a3896 tempest-TestInstancesWithCinderVolumes-1629266108 None] Created volume successfully. Nov 03 08:28:31 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-dbfc2674-2901-4ea2-b2c1-d2a1b78afed2 tempest-ProjectReaderTests-1815156674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c922a71b-401d-40ca-a01e-95deff9d42c8" returned: 0 in 0.327s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:31 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-dbfc2674-2901-4ea2-b2c1-d2a1b78afed2 tempest-ProjectReaderTests-1815156674 None] Lock "cinder-quobyte-c922a71b-401d-40ca-a01e-95deff9d42c8" released by "delete_volume" :: held 0.934s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:28:31 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-dbfc2674-2901-4ea2-b2c1-d2a1b78afed2 tempest-ProjectReaderTests-1815156674 None] Created reservations ['0e939ede-8a5e-46b4-b146-f83622f3b80c', '2d76224e-4f62-4466-8bd9-08f656aea35e', '8b8222a4-d097-40c1-8e2a-412b6bc1e20b', '6abb7783-9f35-4d20-8b10-61c537dab72b'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:28:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-dbfc2674-2901-4ea2-b2c1-d2a1b78afed2 tempest-ProjectReaderTests-1815156674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:28:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-dbfc2674-2901-4ea2-b2c1-d2a1b78afed2 tempest-ProjectReaderTests-1815156674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:28:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-dbfc2674-2901-4ea2-b2c1-d2a1b78afed2 tempest-ProjectReaderTests-1815156674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:28:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-dbfc2674-2901-4ea2-b2c1-d2a1b78afed2 tempest-ProjectReaderTests-1815156674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:28:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-dbfc2674-2901-4ea2-b2c1-d2a1b78afed2 tempest-ProjectReaderTests-1815156674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:28:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-dbfc2674-2901-4ea2-b2c1-d2a1b78afed2 tempest-ProjectReaderTests-1815156674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:31 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:28:31 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:31 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-dbfc2674-2901-4ea2-b2c1-d2a1b78afed2 tempest-ProjectReaderTests-1815156674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.306s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:31 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-dbfc2674-2901-4ea2-b2c1-d2a1b78afed2 tempest-ProjectReaderTests-1815156674 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:28:31 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-dbfc2674-2901-4ea2-b2c1-d2a1b78afed2 tempest-ProjectReaderTests-1815156674 None] Deleted volume successfully. Nov 03 08:28:31 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-dbfc2674-2901-4ea2-b2c1-d2a1b78afed2 tempest-ProjectReaderTests-1815156674 None] Lock "cinder-c922a71b-401d-40ca-a01e-95deff9d42c8-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:28:32 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:28:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Flow 'volume_create_manager' (c7df3848-7b73-411f-99d3-4bd478e5b345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:28:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db6d251b-5789-4cd9-bb97-c14df5c4b790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db6d251b-5789-4cd9-bb97-c14df5c4b790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-668611663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d43dc68-5ddd-429b-b282-fbe42ee27492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52eb4bd5ed6f444e87ab1bae9db4dfc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:28:32Z,use_quota=True,user_id='1622ef86aba94e27bd3a9b2ac7af1fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7080bc26-0a94-476a-be02-fc17e668ce96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7080bc26-0a94-476a-be02-fc17e668ce96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ede2b2-a91c-4eca-b19d-226577d6f2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ede2b2-a91c-4eca-b19d-226577d6f2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d43dc68-5ddd-429b-b282-fbe42ee27492', 'volume_name': 'volume-0d43dc68-5ddd-429b-b282-fbe42ee27492', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f8cdc9-736b-4055-8ae3-ca0f2b379764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f8cdc9-736b-4055-8ae3-ca0f2b379764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2048ff5-7a89-4f7a-9b8f-22750c980c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:32 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Volume 0d43dc68-5ddd-429b-b282-fbe42ee27492: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d43dc68-5ddd-429b-b282-fbe42ee27492', 'volume_size': 1} Nov 03 08:28:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:28:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:28:32 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-668611663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d43dc68-5ddd-429b-b282-fbe42ee27492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52eb4bd5ed6f444e87ab1bae9db4dfc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:28:32Z,use_quota=True,user_id='1622ef86aba94e27bd3a9b2ac7af1fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:28:32 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Creating volume 0d43dc68-5ddd-429b-b282-fbe42ee27492 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:28:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:28:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:28:32 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:28:32 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:28:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:28:32 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:28:32 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:28:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0d43dc68-5ddd-429b-b282-fbe42ee27492 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:32 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0d43dc68-5ddd-429b-b282-fbe42ee27492 1073741824 Nov 03 08:28:32 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:33 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0d43dc68-5ddd-429b-b282-fbe42ee27492 1073741824" returned: 0 in 0.644s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0d43dc68-5ddd-429b-b282-fbe42ee27492 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:33 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0d43dc68-5ddd-429b-b282-fbe42ee27492 Nov 03 08:28:33 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:33 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0d43dc68-5ddd-429b-b282-fbe42ee27492" returned: 0 in 0.315s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:28:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:28:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2048ff5-7a89-4f7a-9b8f-22750c980c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d43dc68-5ddd-429b-b282-fbe42ee27492', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c514bb7c-8a1c-4d65-8650-24165f916932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:33 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Volume volume-0d43dc68-5ddd-429b-b282-fbe42ee27492 (0d43dc68-5ddd-429b-b282-fbe42ee27492): created successfully Nov 03 08:28:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c514bb7c-8a1c-4d65-8650-24165f916932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:33 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Flow 'volume_create_manager' (c7df3848-7b73-411f-99d3-4bd478e5b345) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:28:33 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-8c501b61-0998-4a74-8723-8cd8142debab tempest-ProjectReaderTests-1815156674 None] Created volume successfully. Nov 03 08:28:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-842dd891-9e0e-4acc-a1c8-781d45da22ef tempest-ProjectReaderTests-1815156674 None] Acquiring lock "cinder-0d43dc68-5ddd-429b-b282-fbe42ee27492-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:28:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-842dd891-9e0e-4acc-a1c8-781d45da22ef tempest-ProjectReaderTests-1815156674 None] Lock "cinder-0d43dc68-5ddd-429b-b282-fbe42ee27492-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:28:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-842dd891-9e0e-4acc-a1c8-781d45da22ef tempest-ProjectReaderTests-1815156674 None] Acquiring lock "cinder-quobyte-0d43dc68-5ddd-429b-b282-fbe42ee27492" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:28:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-842dd891-9e0e-4acc-a1c8-781d45da22ef tempest-ProjectReaderTests-1815156674 None] Lock "cinder-quobyte-0d43dc68-5ddd-429b-b282-fbe42ee27492" acquired by "delete_volume" :: waited 0.025s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:28:34 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2c3640-6f18-4619-ae34-72c26b3f3dc6]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:28:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-842dd891-9e0e-4acc-a1c8-781d45da22ef tempest-ProjectReaderTests-1815156674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0d43dc68-5ddd-429b-b282-fbe42ee27492 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:34 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0d43dc68-5ddd-429b-b282-fbe42ee27492 Nov 03 08:28:34 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:35 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-842dd891-9e0e-4acc-a1c8-781d45da22ef tempest-ProjectReaderTests-1815156674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0d43dc68-5ddd-429b-b282-fbe42ee27492" returned: 0 in 0.530s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-842dd891-9e0e-4acc-a1c8-781d45da22ef tempest-ProjectReaderTests-1815156674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0d43dc68-5ddd-429b-b282-fbe42ee27492 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:35 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0d43dc68-5ddd-429b-b282-fbe42ee27492 Nov 03 08:28:35 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:35 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-842dd891-9e0e-4acc-a1c8-781d45da22ef tempest-ProjectReaderTests-1815156674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0d43dc68-5ddd-429b-b282-fbe42ee27492" returned: 0 in 0.283s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:35 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3_6t689bj0devstack@QuobyteHD, size 20.69 MB, duration 5.30 sec {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 08:28:35 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Image download 20.69 MB at 3.90 MB/s Nov 03 08:28:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-842dd891-9e0e-4acc-a1c8-781d45da22ef tempest-ProjectReaderTests-1815156674 None] Lock "cinder-quobyte-0d43dc68-5ddd-429b-b282-fbe42ee27492" released by "delete_volume" :: held 0.897s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:28:35 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e109fb3-6c18-45c1-9087-dcea6993b8bd]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:28:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3_6t689bj0devstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:35 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-842dd891-9e0e-4acc-a1c8-781d45da22ef tempest-ProjectReaderTests-1815156674 None] Created reservations ['73c737a0-853b-445d-9dd4-4b9d6f09e2fc', 'b07661ff-6be3-46f5-b9b5-a06dbf7424b2', 'c0963dd9-3a5c-4306-b4c1-c7f751ff8856', 'af0651c6-8750-4a7f-8fbd-0c67a710c6dc'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:28:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-842dd891-9e0e-4acc-a1c8-781d45da22ef tempest-ProjectReaderTests-1815156674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:28:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-842dd891-9e0e-4acc-a1c8-781d45da22ef tempest-ProjectReaderTests-1815156674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:28:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-842dd891-9e0e-4acc-a1c8-781d45da22ef tempest-ProjectReaderTests-1815156674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:28:35 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3_6t689bj0devstack@QuobyteHD Nov 03 08:28:35 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-842dd891-9e0e-4acc-a1c8-781d45da22ef tempest-ProjectReaderTests-1815156674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:28:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-842dd891-9e0e-4acc-a1c8-781d45da22ef tempest-ProjectReaderTests-1815156674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:28:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-842dd891-9e0e-4acc-a1c8-781d45da22ef tempest-ProjectReaderTests-1815156674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:35 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:28:35 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:35 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3_6t689bj0devstack@QuobyteHD" returned: 0 in 0.388s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:35 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Temporary image b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3 is fetched for user 931a0e8be04c4854b245f4736b6537ca. {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 08:28:35 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-842dd891-9e0e-4acc-a1c8-781d45da22ef tempest-ProjectReaderTests-1815156674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.298s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:35 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-842dd891-9e0e-4acc-a1c8-781d45da22ef tempest-ProjectReaderTests-1815156674 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:28:35 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-842dd891-9e0e-4acc-a1c8-781d45da22ef tempest-ProjectReaderTests-1815156674 None] Deleted volume successfully. Nov 03 08:28:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-842dd891-9e0e-4acc-a1c8-781d45da22ef tempest-ProjectReaderTests-1815156674 None] Lock "cinder-0d43dc68-5ddd-429b-b282-fbe42ee27492-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:28:36 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[947f4150-c6d8-4813-8005-403e02dbec7a]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:28:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3_6t689bj0devstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:36 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3_6t689bj0devstack@QuobyteHD Nov 03 08:28:36 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:36 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3_6t689bj0devstack@QuobyteHD" returned: 0 in 0.351s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:28:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:28:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2080535736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f5909a9-8252-4da6-b393-c8ef910ec39d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9438bfc869c3421f8468b3a5320181e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:28:30Z,use_quota=True,user_id='931a0e8be04c4854b245f4736b6537ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b701cb4e-1a62-46b7-9074-2ac42b7ce899),volume_type_id=b701cb4e-1a62-46b7-9074-2ac42b7ce899)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:28:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Creating volume 8f5909a9-8252-4da6-b393-c8ef910ec39d {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:28:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:28:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:28:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:28:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:28:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:28:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:28:36 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:28:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8f5909a9-8252-4da6-b393-c8ef910ec39d 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:36 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8f5909a9-8252-4da6-b393-c8ef910ec39d 1073741824 Nov 03 08:28:36 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:36 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8f5909a9-8252-4da6-b393-c8ef910ec39d 1073741824" returned: 0 in 0.535s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8f5909a9-8252-4da6-b393-c8ef910ec39d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:36 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8f5909a9-8252-4da6-b393-c8ef910ec39d Nov 03 08:28:36 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:28:37 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Flow 'volume_create_manager' (4e874247-e76c-409a-b2c2-4d1f0b193b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83757d29-6e9a-4715-80ad-309d9c21686c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8f5909a9-8252-4da6-b393-c8ef910ec39d" returned: 0 in 0.392s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83757d29-6e9a-4715-80ad-309d9c21686c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1415209921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a3c12fa-a3b5-4914-9d9d-2f48fa88ff35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52eb4bd5ed6f444e87ab1bae9db4dfc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:28:37Z,use_quota=True,user_id='1622ef86aba94e27bd3a9b2ac7af1fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c45d9a85-8b27-4190-b280-7a330394ae54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c45d9a85-8b27-4190-b280-7a330394ae54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba3575b-f6d1-4f52-9e31-29f3e6b749a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba3575b-f6d1-4f52-9e31-29f3e6b749a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a3c12fa-a3b5-4914-9d9d-2f48fa88ff35', 'volume_name': 'volume-7a3c12fa-a3b5-4914-9d9d-2f48fa88ff35', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a52c470-d04e-4904-bffd-2b2bca99fd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a52c470-d04e-4904-bffd-2b2bca99fd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4bf6780-85e2-45b1-9bce-edd0dc852439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:37 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Volume 7a3c12fa-a3b5-4914-9d9d-2f48fa88ff35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a3c12fa-a3b5-4914-9d9d-2f48fa88ff35', 'volume_size': 1} Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1415209921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a3c12fa-a3b5-4914-9d9d-2f48fa88ff35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52eb4bd5ed6f444e87ab1bae9db4dfc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:28:37Z,use_quota=True,user_id='1622ef86aba94e27bd3a9b2ac7af1fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Creating volume 7a3c12fa-a3b5-4914-9d9d-2f48fa88ff35 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:28:37 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7a3c12fa-a3b5-4914-9d9d-2f48fa88ff35 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Attempting download of b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3 ((None, [{'url': 'file:///opt/stack/data/glance/images/b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3', 'metadata': {}}])) to volume 8f5909a9-8252-4da6-b393-c8ef910ec39d. {{(pid=86801) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 08:28:37 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7a3c12fa-a3b5-4914-9d9d-2f48fa88ff35 1073741824 Nov 03 08:28:37 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fce24d7-ad71-41a0-ae5b-fd50c9d7e3cc]: (4, 'raw') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3_eosmh0p7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:37 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3_eosmh0p7 Nov 03 08:28:37 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:37 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3_eosmh0p7" returned: 0 in 0.352s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3_eosmh0p7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:37 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7a3c12fa-a3b5-4914-9d9d-2f48fa88ff35 1073741824" returned: 0 in 0.469s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7a3c12fa-a3b5-4914-9d9d-2f48fa88ff35 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:37 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7a3c12fa-a3b5-4914-9d9d-2f48fa88ff35 Nov 03 08:28:37 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:38 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3_eosmh0p7 Nov 03 08:28:38 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:38 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7a3c12fa-a3b5-4914-9d9d-2f48fa88ff35" returned: 0 in 0.268s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:28:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:28:38 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4bf6780-85e2-45b1-9bce-edd0dc852439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a3c12fa-a3b5-4914-9d9d-2f48fa88ff35', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (967b90eb-9988-42f5-8458-1319480f46b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3_eosmh0p7" returned: 1 in 0.380s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3_eosmh0p7' failed. Not Retrying. {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 08:28:38 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d68948a-735d-4079-a6b2-91a3b752bdd6]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:28:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3_6t689bj0devstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:38 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Volume volume-7a3c12fa-a3b5-4914-9d9d-2f48fa88ff35 (7a3c12fa-a3b5-4914-9d9d-2f48fa88ff35): created successfully Nov 03 08:28:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (967b90eb-9988-42f5-8458-1319480f46b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Flow 'volume_create_manager' (4e874247-e76c-409a-b2c2-4d1f0b193b3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:28:38 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-0e553ba1-6e2c-4e06-97c6-9df934ddeebf tempest-ProjectReaderTests-1815156674 None] Created volume successfully. Nov 03 08:28:38 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3_6t689bj0devstack@QuobyteHD Nov 03 08:28:38 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:38 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3_6t689bj0devstack@QuobyteHD" returned: 0 in 0.341s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:38 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3 was qcow2, converting to qcow2 {{(pid=86801) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 08:28:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3_6t689bj0devstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8f5909a9-8252-4da6-b393-c8ef910ec39d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:38 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3_6t689bj0devstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8f5909a9-8252-4da6-b393-c8ef910ec39d Nov 03 08:28:38 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-49d24631-37df-4799-be59-7df592697eb3 tempest-ProjectReaderTests-1815156674 None] Acquiring lock "cinder-7a3c12fa-a3b5-4914-9d9d-2f48fa88ff35-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:28:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-49d24631-37df-4799-be59-7df592697eb3 tempest-ProjectReaderTests-1815156674 None] Lock "cinder-7a3c12fa-a3b5-4914-9d9d-2f48fa88ff35-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:28:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-49d24631-37df-4799-be59-7df592697eb3 tempest-ProjectReaderTests-1815156674 None] Acquiring lock "cinder-quobyte-7a3c12fa-a3b5-4914-9d9d-2f48fa88ff35" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:28:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-49d24631-37df-4799-be59-7df592697eb3 tempest-ProjectReaderTests-1815156674 None] Lock "cinder-quobyte-7a3c12fa-a3b5-4914-9d9d-2f48fa88ff35" acquired by "delete_volume" :: waited 0.018s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:28:39 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a53c518-7d46-4937-a775-65a478f2805e]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:28:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-49d24631-37df-4799-be59-7df592697eb3 tempest-ProjectReaderTests-1815156674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7a3c12fa-a3b5-4914-9d9d-2f48fa88ff35 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:39 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7a3c12fa-a3b5-4914-9d9d-2f48fa88ff35 Nov 03 08:28:39 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:40 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-49d24631-37df-4799-be59-7df592697eb3 tempest-ProjectReaderTests-1815156674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7a3c12fa-a3b5-4914-9d9d-2f48fa88ff35" returned: 0 in 0.456s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-49d24631-37df-4799-be59-7df592697eb3 tempest-ProjectReaderTests-1815156674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7a3c12fa-a3b5-4914-9d9d-2f48fa88ff35 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:40 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7a3c12fa-a3b5-4914-9d9d-2f48fa88ff35 Nov 03 08:28:40 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:40 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-49d24631-37df-4799-be59-7df592697eb3 tempest-ProjectReaderTests-1815156674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7a3c12fa-a3b5-4914-9d9d-2f48fa88ff35" returned: 0 in 0.278s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-49d24631-37df-4799-be59-7df592697eb3 tempest-ProjectReaderTests-1815156674 None] Lock "cinder-quobyte-7a3c12fa-a3b5-4914-9d9d-2f48fa88ff35" released by "delete_volume" :: held 0.782s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:28:40 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-49d24631-37df-4799-be59-7df592697eb3 tempest-ProjectReaderTests-1815156674 None] Created reservations ['f04220bc-a194-46a5-8c0b-bbfea0fceb5e', 'd53b0900-8448-4270-9884-217cce0e0d7b', '5342cc3b-00f7-4129-bdad-e4dba421860b', '46c875a9-81bf-4cb3-9727-308762317aea'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:28:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-49d24631-37df-4799-be59-7df592697eb3 tempest-ProjectReaderTests-1815156674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:28:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-49d24631-37df-4799-be59-7df592697eb3 tempest-ProjectReaderTests-1815156674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:28:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-49d24631-37df-4799-be59-7df592697eb3 tempest-ProjectReaderTests-1815156674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:28:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-49d24631-37df-4799-be59-7df592697eb3 tempest-ProjectReaderTests-1815156674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:28:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-49d24631-37df-4799-be59-7df592697eb3 tempest-ProjectReaderTests-1815156674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:28:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-49d24631-37df-4799-be59-7df592697eb3 tempest-ProjectReaderTests-1815156674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:40 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:28:40 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:40 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3_6t689bj0devstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8f5909a9-8252-4da6-b393-c8ef910ec39d" returned: 0 in 2.076s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:40 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3_6t689bj0devstack@QuobyteHD, size 112.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8f5909a9-8252-4da6-b393-c8ef910ec39d {{(pid=86801) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 08:28:40 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Converted 112.00 MB image at 53.89 MB/s Nov 03 08:28:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8f5909a9-8252-4da6-b393-c8ef910ec39d 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:40 devstack sudo[102424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8f5909a9-8252-4da6-b393-c8ef910ec39d 1G Nov 03 08:28:40 devstack sudo[102424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:40 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-49d24631-37df-4799-be59-7df592697eb3 tempest-ProjectReaderTests-1815156674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.276s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:40 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-49d24631-37df-4799-be59-7df592697eb3 tempest-ProjectReaderTests-1815156674 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:28:40 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-49d24631-37df-4799-be59-7df592697eb3 tempest-ProjectReaderTests-1815156674 None] Deleted volume successfully. Nov 03 08:28:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-49d24631-37df-4799-be59-7df592697eb3 tempest-ProjectReaderTests-1815156674 None] Lock "cinder-7a3c12fa-a3b5-4914-9d9d-2f48fa88ff35-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:28:41 devstack sudo[102424]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8f5909a9-8252-4da6-b393-c8ef910ec39d 1G" returned: 0 in 0.526s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Downloaded image b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3 ((None, [{'url': 'file:///opt/stack/data/glance/images/b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3', 'metadata': {}}])) to volume 8f5909a9-8252-4da6-b393-c8ef910ec39d successfully. {{(pid=86801) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Temporary image b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3 for user 931a0e8be04c4854b245f4736b6537ca is deleted. {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Marking volume 8f5909a9-8252-4da6-b393-c8ef910ec39d as bootable. {{(pid=86801) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Copying metadata from image b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3 to 8f5909a9-8252-4da6-b393-c8ef910ec39d. {{(pid=86801) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Creating volume glance metadata for volume 8f5909a9-8252-4da6-b393-c8ef910ec39d backed by image b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3 with: {'image_id': 'b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3', 'image_name': 'tempest-scenario-img--63217776', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86801) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6541df73-6470-4402-943c-a79e87292742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f5909a9-8252-4da6-b393-c8ef910ec39d', 'volume_size': 1, 'image_id': 'b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--63217776', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9438bfc869c3421f8468b3a5320181e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3', 'created_at': datetime.datetime(2026, 11, 3, 7, 28, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 28, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0d0b3ce-8e83-48d5-b484-ff2ac4bd58f3/file', 'properties': {}}, 'image_service': }' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18454d18-c97c-4b04-91d0-088d29beb557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:41 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Volume volume-8f5909a9-8252-4da6-b393-c8ef910ec39d (8f5909a9-8252-4da6-b393-c8ef910ec39d): created successfully Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18454d18-c97c-4b04-91d0-088d29beb557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Flow 'volume_create_manager' (6f0990ae-ed22-41d6-b251-4c748498a167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Flow 'volume_create_manager' (47e9b0c2-ee38-404f-8979-485a8c87f864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca3585f-3b83-41fc-b0ef-842478df1cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca3585f-3b83-41fc-b0ef-842478df1cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-492010121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2763cd17-b1d2-41df-aff1-83ba098e2069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52eb4bd5ed6f444e87ab1bae9db4dfc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:28:41Z,use_quota=True,user_id='1622ef86aba94e27bd3a9b2ac7af1fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ff6a39-60b1-4677-907f-556c1a250d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ff6a39-60b1-4677-907f-556c1a250d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b36bc1-a57a-4067-a0f7-4bb39d053bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b36bc1-a57a-4067-a0f7-4bb39d053bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2763cd17-b1d2-41df-aff1-83ba098e2069', 'volume_name': 'volume-2763cd17-b1d2-41df-aff1-83ba098e2069', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e4a43a-99bb-449c-a29a-f3629cfeea2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e4a43a-99bb-449c-a29a-f3629cfeea2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (711d4772-5902-4bec-8313-33cf9f105eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:41 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Volume 2763cd17-b1d2-41df-aff1-83ba098e2069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2763cd17-b1d2-41df-aff1-83ba098e2069', 'volume_size': 1} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-492010121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2763cd17-b1d2-41df-aff1-83ba098e2069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52eb4bd5ed6f444e87ab1bae9db4dfc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:28:41Z,use_quota=True,user_id='1622ef86aba94e27bd3a9b2ac7af1fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Creating volume 2763cd17-b1d2-41df-aff1-83ba098e2069 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:28:41 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:28:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2763cd17-b1d2-41df-aff1-83ba098e2069 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:41 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-bb3a36fd-bdb8-4f2f-a712-9e08d1034504 tempest-TestInstancesWithCinderVolumes-1629266108 None] Created volume successfully. Nov 03 08:28:41 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2763cd17-b1d2-41df-aff1-83ba098e2069 1073741824 Nov 03 08:28:41 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:42 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2763cd17-b1d2-41df-aff1-83ba098e2069 1073741824" returned: 0 in 0.574s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2763cd17-b1d2-41df-aff1-83ba098e2069 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:42 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2763cd17-b1d2-41df-aff1-83ba098e2069 Nov 03 08:28:42 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:42 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2763cd17-b1d2-41df-aff1-83ba098e2069" returned: 0 in 0.313s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:42 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:28:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:28:42 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (711d4772-5902-4bec-8313-33cf9f105eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2763cd17-b1d2-41df-aff1-83ba098e2069', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:42 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd66dfd-0cff-4393-ac80-413c424f82ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:42 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Volume volume-2763cd17-b1d2-41df-aff1-83ba098e2069 (2763cd17-b1d2-41df-aff1-83ba098e2069): created successfully Nov 03 08:28:42 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd66dfd-0cff-4393-ac80-413c424f82ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:42 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Flow 'volume_create_manager' (47e9b0c2-ee38-404f-8979-485a8c87f864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:28:42 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-463e585d-16b4-439b-a564-729148bb9f81 tempest-ProjectReaderTests-1815156674 None] Created volume successfully. Nov 03 08:28:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d0b0a71a-451f-4f80-8519-55424d4c5647 tempest-ProjectReaderTests-1815156674 None] Acquiring lock "cinder-2763cd17-b1d2-41df-aff1-83ba098e2069-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:28:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d0b0a71a-451f-4f80-8519-55424d4c5647 tempest-ProjectReaderTests-1815156674 None] Lock "cinder-2763cd17-b1d2-41df-aff1-83ba098e2069-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:28:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d0b0a71a-451f-4f80-8519-55424d4c5647 tempest-ProjectReaderTests-1815156674 None] Acquiring lock "cinder-quobyte-2763cd17-b1d2-41df-aff1-83ba098e2069" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:28:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d0b0a71a-451f-4f80-8519-55424d4c5647 tempest-ProjectReaderTests-1815156674 None] Lock "cinder-quobyte-2763cd17-b1d2-41df-aff1-83ba098e2069" acquired by "delete_volume" :: waited 0.024s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:28:43 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cff33b9-4617-4ac4-90db-af0b5431feac]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:28:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d0b0a71a-451f-4f80-8519-55424d4c5647 tempest-ProjectReaderTests-1815156674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2763cd17-b1d2-41df-aff1-83ba098e2069 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:44 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2763cd17-b1d2-41df-aff1-83ba098e2069 Nov 03 08:28:44 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:44 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d0b0a71a-451f-4f80-8519-55424d4c5647 tempest-ProjectReaderTests-1815156674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2763cd17-b1d2-41df-aff1-83ba098e2069" returned: 0 in 0.538s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d0b0a71a-451f-4f80-8519-55424d4c5647 tempest-ProjectReaderTests-1815156674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2763cd17-b1d2-41df-aff1-83ba098e2069 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:44 devstack sudo[102450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2763cd17-b1d2-41df-aff1-83ba098e2069 Nov 03 08:28:44 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:44 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d0b0a71a-451f-4f80-8519-55424d4c5647 tempest-ProjectReaderTests-1815156674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2763cd17-b1d2-41df-aff1-83ba098e2069" returned: 0 in 0.298s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d0b0a71a-451f-4f80-8519-55424d4c5647 tempest-ProjectReaderTests-1815156674 None] Lock "cinder-quobyte-2763cd17-b1d2-41df-aff1-83ba098e2069" released by "delete_volume" :: held 0.916s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:28:44 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-d0b0a71a-451f-4f80-8519-55424d4c5647 tempest-ProjectReaderTests-1815156674 None] Created reservations ['b71d41ec-8247-4066-9780-8ee01dbdd0ea', '794db6e8-cf03-4041-8b6e-b2ad29cf0c75', '5957f0c3-faca-486c-98be-3e1dabc9e54a', '62b3cbff-7d11-4e3e-811c-f04741e2dee9'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:28:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d0b0a71a-451f-4f80-8519-55424d4c5647 tempest-ProjectReaderTests-1815156674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:28:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d0b0a71a-451f-4f80-8519-55424d4c5647 tempest-ProjectReaderTests-1815156674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:28:44 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d0b0a71a-451f-4f80-8519-55424d4c5647 tempest-ProjectReaderTests-1815156674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:28:44 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d0b0a71a-451f-4f80-8519-55424d4c5647 tempest-ProjectReaderTests-1815156674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:28:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d0b0a71a-451f-4f80-8519-55424d4c5647 tempest-ProjectReaderTests-1815156674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:28:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d0b0a71a-451f-4f80-8519-55424d4c5647 tempest-ProjectReaderTests-1815156674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:44 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:28:44 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:45 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d0b0a71a-451f-4f80-8519-55424d4c5647 tempest-ProjectReaderTests-1815156674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.382s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:45 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-d0b0a71a-451f-4f80-8519-55424d4c5647 tempest-ProjectReaderTests-1815156674 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:28:45 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-d0b0a71a-451f-4f80-8519-55424d4c5647 tempest-ProjectReaderTests-1815156674 None] Deleted volume successfully. Nov 03 08:28:45 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d0b0a71a-451f-4f80-8519-55424d4c5647 tempest-ProjectReaderTests-1815156674 None] Lock "cinder-2763cd17-b1d2-41df-aff1-83ba098e2069-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:28:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-90bcb4ec-0240-4d02-a096-fc531e5cc9e9 req-7f851ef7-7f66-4792-a052-412e5e5e6717 tempest-TestInstancesWithCinderVolumes-1629266108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:28:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-90bcb4ec-0240-4d02-a096-fc531e5cc9e9 req-7f851ef7-7f66-4792-a052-412e5e5e6717 tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:28:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-90bcb4ec-0240-4d02-a096-fc531e5cc9e9 req-7f851ef7-7f66-4792-a052-412e5e5e6717 tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:28:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-90bcb4ec-0240-4d02-a096-fc531e5cc9e9 req-7f851ef7-7f66-4792-a052-412e5e5e6717 tempest-TestInstancesWithCinderVolumes-1629266108 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f', 'name': 'volume-8f5909a9-8252-4da6-b393-c8ef910ec39d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3e1d3ca-a70c-44d4-bad6-f4c1c95637c0', 'enforce_multipath': True} {{(pid=86801) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 08:28:45 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-90bcb4ec-0240-4d02-a096-fc531e5cc9e9 req-7f851ef7-7f66-4792-a052-412e5e5e6717 tempest-TestInstancesWithCinderVolumes-1629266108 None] attachment_update completed successfully. Nov 03 08:28:52 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:28:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Flow 'volume_create_manager' (2f144ee8-f8e0-48bf-ad81-cfceabc9513a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:28:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ecf75d4-f87e-4551-991b-bf0395c57499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ecf75d4-f87e-4551-991b-bf0395c57499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-200292379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153e5137-ecb9-4698-9c07-d62e2dba1842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e13e2ac1391430b8eb38ebb11948bc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:28:52Z,use_quota=True,user_id='df0becba307542cca0fab2c22c327827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (045757bb-6531-4795-a01f-f8a8738c7344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (045757bb-6531-4795-a01f-f8a8738c7344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bcde798-b33a-4ee2-bd83-90449b124dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:52 devstack cinder-volume[86801]: DEBUG cinder.image.glance [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Creating Keystone auth plugin from conf {{(pid=86801) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 08:28:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bcde798-b33a-4ee2-bd83-90449b124dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '153e5137-ecb9-4698-9c07-d62e2dba1842', 'volume_name': 'volume-153e5137-ecb9-4698-9c07-d62e2dba1842', 'volume_size': 1, 'image_id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02c779626a284994918db1738b55fe79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'created_at': datetime.datetime(2026, 11, 3, 7, 8, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 8, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9eb5e936-be4c-46be-8de8-899e9fc38d33/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f5eb3c4-bf8a-46c9-9095-53a50e9e2d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f5eb3c4-bf8a-46c9-9095-53a50e9e2d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:28:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7b47101-26ee-41fb-b9d8-b5968b4cb1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:28:52 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Volume 153e5137-ecb9-4698-9c07-d62e2dba1842: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-153e5137-ecb9-4698-9c07-d62e2dba1842', 'volume_size': 1, 'image_id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02c779626a284994918db1738b55fe79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'created_at': datetime.datetime(2026, 11, 3, 7, 8, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 8, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9eb5e936-be4c-46be-8de8-899e9fc38d33/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 08:28:52 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Trying to clone 153e5137-ecb9-4698-9c07-d62e2dba1842 from image 9eb5e936-be4c-46be-8de8-899e9fc38d33 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}]). {{(pid=86801) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 08:28:53 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_m1y2pegmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 08:28:53 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Image download 20.69 MB at 20.69 MB/s Nov 03 08:28:53 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b0f741-65b9-411f-bcda-ca753a292dcf]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:28:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_m1y2pegmdevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:53 devstack sudo[102950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_m1y2pegmdevstack@QuobyteHD Nov 03 08:28:53 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:54 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_m1y2pegmdevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:54 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Temporary image 9eb5e936-be4c-46be-8de8-899e9fc38d33 is fetched for user df0becba307542cca0fab2c22c327827. {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 08:28:54 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2875459-97af-4bf4-ac74-ebd6d53fd2cd]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:28:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_m1y2pegmdevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:54 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_m1y2pegmdevstack@QuobyteHD Nov 03 08:28:54 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:54 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_m1y2pegmdevstack@QuobyteHD" returned: 0 in 0.589s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:28:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:28:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-200292379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153e5137-ecb9-4698-9c07-d62e2dba1842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e13e2ac1391430b8eb38ebb11948bc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:28:52Z,use_quota=True,user_id='df0becba307542cca0fab2c22c327827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:28:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Creating volume 153e5137-ecb9-4698-9c07-d62e2dba1842 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:28:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:28:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:28:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:28:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:28:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:28:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:28:54 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:28:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-153e5137-ecb9-4698-9c07-d62e2dba1842 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:55 devstack sudo[102963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-153e5137-ecb9-4698-9c07-d62e2dba1842 1073741824 Nov 03 08:28:55 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:55 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-153e5137-ecb9-4698-9c07-d62e2dba1842 1073741824" returned: 0 in 0.742s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-153e5137-ecb9-4698-9c07-d62e2dba1842 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:55 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-153e5137-ecb9-4698-9c07-d62e2dba1842 Nov 03 08:28:55 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:56 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-153e5137-ecb9-4698-9c07-d62e2dba1842" returned: 0 in 0.459s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:56 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:28:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:28:56 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Attempting download of 9eb5e936-be4c-46be-8de8-899e9fc38d33 ((None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}])) to volume 153e5137-ecb9-4698-9c07-d62e2dba1842. {{(pid=86801) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 08:28:56 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[2764adf7-c37d-4518-86a9-cc561f9386c0]: (4, 'raw') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:28:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_32pmld_3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:56 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_32pmld_3 Nov 03 08:28:56 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:56 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_32pmld_3" returned: 0 in 0.551s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_32pmld_3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:57 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_32pmld_3 Nov 03 08:28:57 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:57 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_32pmld_3" returned: 1 in 0.628s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9eb5e936-be4c-46be-8de8-899e9fc38d33_32pmld_3' failed. Not Retrying. {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 08:28:57 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b586946-b452-4afb-85d7-3879066a2285]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:28:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_m1y2pegmdevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:57 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_m1y2pegmdevstack@QuobyteHD Nov 03 08:28:57 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:28:58 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Nov 03 08:28:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_m1y2pegmdevstack@QuobyteHD" returned: 0 in 0.565s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:28:58 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] 9eb5e936-be4c-46be-8de8-899e9fc38d33 was qcow2, converting to qcow2 {{(pid=86801) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 08:28:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_m1y2pegmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-153e5137-ecb9-4698-9c07-d62e2dba1842 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:28:58 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_m1y2pegmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-153e5137-ecb9-4698-9c07-d62e2dba1842 Nov 03 08:28:58 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:01 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_m1y2pegmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-153e5137-ecb9-4698-9c07-d62e2dba1842" returned: 0 in 2.913s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:01 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9eb5e936-be4c-46be-8de8-899e9fc38d33_m1y2pegmdevstack@QuobyteHD, size 112.00 MB, duration 2.91 sec, destination /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-153e5137-ecb9-4698-9c07-d62e2dba1842 {{(pid=86801) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 08:29:01 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Converted 112.00 MB image at 38.42 MB/s Nov 03 08:29:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-153e5137-ecb9-4698-9c07-d62e2dba1842 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:01 devstack sudo[102998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-153e5137-ecb9-4698-9c07-d62e2dba1842 1G Nov 03 08:29:01 devstack sudo[102998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:01 devstack sudo[102998]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-153e5137-ecb9-4698-9c07-d62e2dba1842 1G" returned: 0 in 0.431s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:01 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Downloaded image 9eb5e936-be4c-46be-8de8-899e9fc38d33 ((None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}])) to volume 153e5137-ecb9-4698-9c07-d62e2dba1842 successfully. {{(pid=86801) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 08:29:01 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Temporary image 9eb5e936-be4c-46be-8de8-899e9fc38d33 for user df0becba307542cca0fab2c22c327827 is deleted. {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 08:29:01 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Marking volume 153e5137-ecb9-4698-9c07-d62e2dba1842 as bootable. {{(pid=86801) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 08:29:01 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Copying metadata from image 9eb5e936-be4c-46be-8de8-899e9fc38d33 to 153e5137-ecb9-4698-9c07-d62e2dba1842. {{(pid=86801) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 08:29:01 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Creating volume glance metadata for volume 153e5137-ecb9-4698-9c07-d62e2dba1842 backed by image 9eb5e936-be4c-46be-8de8-899e9fc38d33 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86801) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 08:29:01 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7b47101-26ee-41fb-b9d8-b5968b4cb1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-153e5137-ecb9-4698-9c07-d62e2dba1842', 'volume_size': 1, 'image_id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9eb5e936-be4c-46be-8de8-899e9fc38d33', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02c779626a284994918db1738b55fe79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9eb5e936-be4c-46be-8de8-899e9fc38d33', 'created_at': datetime.datetime(2026, 11, 3, 7, 8, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 8, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9eb5e936-be4c-46be-8de8-899e9fc38d33/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:29:01 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (111ab4ce-26d6-41a3-9d9b-24401b91f08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:29:01 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Volume volume-153e5137-ecb9-4698-9c07-d62e2dba1842 (153e5137-ecb9-4698-9c07-d62e2dba1842): created successfully Nov 03 08:29:01 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (111ab4ce-26d6-41a3-9d9b-24401b91f08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:29:01 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Flow 'volume_create_manager' (2f144ee8-f8e0-48bf-ad81-cfceabc9513a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:29:01 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-6cb24552-1449-4b25-b45d-701793f15e93 tempest-TestShelveInstance-695935799 None] Created volume successfully. Nov 03 08:29:03 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:29:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:29:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:29:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:29:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:29:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:29:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:03 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:29:03 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:04 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.397s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:04 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:29:04 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager._thread_info {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:29:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread count: 29 {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 08:29:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread info: [<_MainThread(MainThread, started 139707544170624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 08:29:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-93883fde-43b1-4fe2-b612-8efa892e06dd req-b9cb7ec2-db36-4f05-8865-bb428852d195 tempest-TestShelveInstance-695935799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:29:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-93883fde-43b1-4fe2-b612-8efa892e06dd req-b9cb7ec2-db36-4f05-8865-bb428852d195 tempest-TestShelveInstance-695935799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:29:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-93883fde-43b1-4fe2-b612-8efa892e06dd req-b9cb7ec2-db36-4f05-8865-bb428852d195 tempest-TestShelveInstance-695935799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:29:07 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-93883fde-43b1-4fe2-b612-8efa892e06dd req-b9cb7ec2-db36-4f05-8865-bb428852d195 tempest-TestShelveInstance-695935799 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f', 'name': 'volume-153e5137-ecb9-4698-9c07-d62e2dba1842', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '64927ca4-a326-4b10-a1e3-b421ea9f6374', 'enforce_multipath': True} {{(pid=86801) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 08:29:07 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-93883fde-43b1-4fe2-b612-8efa892e06dd req-b9cb7ec2-db36-4f05-8865-bb428852d195 tempest-TestShelveInstance-695935799 None] attachment_update completed successfully. Nov 03 08:29:17 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:29:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Flow 'volume_create_manager' (4ea74b10-1324-41e9-bd82-8f7aa4ca244a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:29:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48e12cfd-4779-4f8f-b209-0096b2d08a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:29:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48e12cfd-4779-4f8f-b209-0096b2d08a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-591984603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eeebfc6-d1c7-432c-8271-3b907a5fe02c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe426cce3b834d6885125cc44f897a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:29:17Z,use_quota=True,user_id='2bd659839e8c44959c0a2e7db79974f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:29:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0bd7321-e7be-4a05-9194-7cc70539ae4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:29:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0bd7321-e7be-4a05-9194-7cc70539ae4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:29:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c74f81d-8955-4a2d-b230-429aa8ec2fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:29:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c74f81d-8955-4a2d-b230-429aa8ec2fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eeebfc6-d1c7-432c-8271-3b907a5fe02c', 'volume_name': 'volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:29:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490b5fb2-17b4-45a7-883a-73da3ebefa6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:29:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490b5fb2-17b4-45a7-883a-73da3ebefa6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:29:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41985720-78c3-4a47-b632-db3b8272aa10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:29:17 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Volume 5eeebfc6-d1c7-432c-8271-3b907a5fe02c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c', 'volume_size': 1} Nov 03 08:29:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:29:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:29:17 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-591984603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eeebfc6-d1c7-432c-8271-3b907a5fe02c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe426cce3b834d6885125cc44f897a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:29:17Z,use_quota=True,user_id='2bd659839e8c44959c0a2e7db79974f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:29:17 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Creating volume 5eeebfc6-d1c7-432c-8271-3b907a5fe02c {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:29:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:29:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:29:17 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:29:17 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:29:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:29:17 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:29:17 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:29:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:17 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c 1073741824 Nov 03 08:29:17 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:18 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c 1073741824" returned: 0 in 0.570s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:18 devstack sudo[103179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c Nov 03 08:29:18 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:18 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c" returned: 0 in 0.489s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:18 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:29:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:29:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41985720-78c3-4a47-b632-db3b8272aa10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:29:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (831ea4f2-f58b-41b8-a1a6-da5356285ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:29:18 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Volume volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c (5eeebfc6-d1c7-432c-8271-3b907a5fe02c): created successfully Nov 03 08:29:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (831ea4f2-f58b-41b8-a1a6-da5356285ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:29:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Flow 'volume_create_manager' (4ea74b10-1324-41e9-bd82-8f7aa4ca244a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:29:18 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-679b088f-31bb-45fa-b828-67ee9117ab62 tempest-SnapshotDependencyTests-1461784332 None] Created volume successfully. Nov 03 08:29:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e1f3fb2d-4621-422d-87ef-44040360090d tempest-SnapshotDependencyTests-1461784332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:29:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e1f3fb2d-4621-422d-87ef-44040360090d tempest-SnapshotDependencyTests-1461784332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:29:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-e1f3fb2d-4621-422d-87ef-44040360090d tempest-SnapshotDependencyTests-1461784332 None] Creating offline snapshot 8459c448-5aaa-48a4-9394-b7e24308c705 of volume 5eeebfc6-d1c7-432c-8271-3b907a5fe02c {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:29:20 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3ae2f0-e6b0-4616-a184-78f64086e445]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:29:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e1f3fb2d-4621-422d-87ef-44040360090d tempest-SnapshotDependencyTests-1461784332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:20 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c Nov 03 08:29:20 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-e9ab6075-05b4-4bba-b33f-30295dfe220b req-c208198a-376f-4291-b6d8-b9c2acbc08db tempest-TestInstancesWithCinderVolumes-1629266108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:29:20 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e1f3fb2d-4621-422d-87ef-44040360090d tempest-SnapshotDependencyTests-1461784332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c" returned: 0 in 0.513s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e1f3fb2d-4621-422d-87ef-44040360090d tempest-SnapshotDependencyTests-1461784332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.8459c448-5aaa-48a4-9394-b7e24308c705 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:20 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.8459c448-5aaa-48a4-9394-b7e24308c705 1G Nov 03 08:29:20 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:21 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e1f3fb2d-4621-422d-87ef-44040360090d tempest-SnapshotDependencyTests-1461784332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.8459c448-5aaa-48a4-9394-b7e24308c705 1G" returned: 0 in 0.400s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e1f3fb2d-4621-422d-87ef-44040360090d tempest-SnapshotDependencyTests-1461784332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.8459c448-5aaa-48a4-9394-b7e24308c705 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:21 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.8459c448-5aaa-48a4-9394-b7e24308c705 Nov 03 08:29:21 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:21 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e1f3fb2d-4621-422d-87ef-44040360090d tempest-SnapshotDependencyTests-1461784332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.8459c448-5aaa-48a4-9394-b7e24308c705" returned: 0 in 0.310s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:21 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-e1f3fb2d-4621-422d-87ef-44040360090d tempest-SnapshotDependencyTests-1461784332 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.8459c448-5aaa-48a4-9394-b7e24308c705 is being set with open permissions: ugo+rw Nov 03 08:29:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e1f3fb2d-4621-422d-87ef-44040360090d tempest-SnapshotDependencyTests-1461784332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.8459c448-5aaa-48a4-9394-b7e24308c705 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:21 devstack sudo[103215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.8459c448-5aaa-48a4-9394-b7e24308c705 Nov 03 08:29:21 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:21 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e1f3fb2d-4621-422d-87ef-44040360090d tempest-SnapshotDependencyTests-1461784332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.8459c448-5aaa-48a4-9394-b7e24308c705" returned: 0 in 0.249s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:21 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=63,cinder:UPDATE=71,cinder:INSERT=31,cinder:DELETE=5 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:29:21 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:UPDATE=61,cinder:SELECT=72,cinder:DELETE=8,cinder:INSERT=16 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:29:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e1f3fb2d-4621-422d-87ef-44040360090d tempest-SnapshotDependencyTests-1461784332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:21 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.info Nov 03 08:29:21 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:21 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e1f3fb2d-4621-422d-87ef-44040360090d tempest-SnapshotDependencyTests-1461784332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.info" returned: 0 in 0.249s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:21 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-e1f3fb2d-4621-422d-87ef-44040360090d tempest-SnapshotDependencyTests-1461784332 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.info is being set with open permissions: ugo+rw Nov 03 08:29:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e1f3fb2d-4621-422d-87ef-44040360090d tempest-SnapshotDependencyTests-1461784332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:21 devstack sudo[103221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.info Nov 03 08:29:21 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:22 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e1f3fb2d-4621-422d-87ef-44040360090d tempest-SnapshotDependencyTests-1461784332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.info" returned: 0 in 0.282s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e1f3fb2d-4621-422d-87ef-44040360090d tempest-SnapshotDependencyTests-1461784332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.161s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:29:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-e9ab6075-05b4-4bba-b33f-30295dfe220b req-c208198a-376f-4291-b6d8-b9c2acbc08db tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.776s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:29:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-e9ab6075-05b4-4bba-b33f-30295dfe220b req-c208198a-376f-4291-b6d8-b9c2acbc08db tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:29:22 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-e1f3fb2d-4621-422d-87ef-44040360090d tempest-SnapshotDependencyTests-1461784332 None] Create snapshot completed successfully Nov 03 08:29:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-e9ab6075-05b4-4bba-b33f-30295dfe220b req-c208198a-376f-4291-b6d8-b9c2acbc08db tempest-TestInstancesWithCinderVolumes-1629266108 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f', 'name': 'volume-e4f31846-5f73-4b91-bbc8-0595af258569', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43313f6b-75cf-4c5d-86cc-46820a0e1169', 'enforce_multipath': True} {{(pid=86801) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 08:29:22 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-e9ab6075-05b4-4bba-b33f-30295dfe220b req-c208198a-376f-4291-b6d8-b9c2acbc08db tempest-TestInstancesWithCinderVolumes-1629266108 None] attachment_update completed successfully. Nov 03 08:29:23 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:29:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Flow 'volume_create_manager' (b6ad48d1-635c-44b4-87af-36e657cba2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:29:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (591d9ebd-6446-4cef-ab13-0376ed60ec2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:29:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (591d9ebd-6446-4cef-ab13-0376ed60ec2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85272482-48bd-4ea6-a840-b24e4caf786e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe426cce3b834d6885125cc44f897a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8459c448-5aaa-48a4-9394-b7e24308c705,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:29:24Z,use_quota=True,user_id='2bd659839e8c44959c0a2e7db79974f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:29:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0232a9ce-bb30-4056-9b9c-b7be5dbf5fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:29:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0232a9ce-bb30-4056-9b9c-b7be5dbf5fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:29:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8bea981-26a4-40f6-bcc6-7b0f938d1b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:29:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8bea981-26a4-40f6-bcc6-7b0f938d1b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '85272482-48bd-4ea6-a840-b24e4caf786e', 'volume_name': 'volume-85272482-48bd-4ea6-a840-b24e4caf786e', 'volume_size': 1, 'snapshot_id': '8459c448-5aaa-48a4-9394-b7e24308c705'}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:29:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e3b04f-bd11-4956-bbc7-7fd862f07709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:29:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e3b04f-bd11-4956-bbc7-7fd862f07709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:29:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520fa4d6-50ea-4bcd-b636-13c6360a87fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:29:23 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Volume 85272482-48bd-4ea6-a840-b24e4caf786e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-85272482-48bd-4ea6-a840-b24e4caf786e', 'volume_size': 1, 'snapshot_id': '8459c448-5aaa-48a4-9394-b7e24308c705'} Nov 03 08:29:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:29:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:29:23 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Acquiring lock "cinder-quobyte-8459c448-5aaa-48a4-9394-b7e24308c705-85272482-48bd-4ea6-a840-b24e4caf786e" by "_create_volume_from_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:29:24 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Lock "cinder-quobyte-8459c448-5aaa-48a4-9394-b7e24308c705-85272482-48bd-4ea6-a840-b24e4caf786e" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:29:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Creating volume 85272482-48bd-4ea6-a840-b24e4caf786e from snapshot 8459c448-5aaa-48a4-9394-b7e24308c705 {{(pid=86801) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 08:29:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:29:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:29:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:29:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:29:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:29:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:29:24 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Acquiring lock "cinder-quobyte-85272482-48bd-4ea6-a840-b24e4caf786e" by "_copy_volume_from_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:29:24 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Lock "cinder-quobyte-85272482-48bd-4ea6-a840-b24e4caf786e" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:29:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] snapshot: 8459c448-5aaa-48a4-9394-b7e24308c705, volume: 85272482-48bd-4ea6-a840-b24e4caf786e, {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 08:29:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:29:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:29:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:29:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:29:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:29:24 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce31b346-9653-457e-9989-9b66fafcb776]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:29:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.8459c448-5aaa-48a4-9394-b7e24308c705 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:24 devstack sudo[103235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.8459c448-5aaa-48a4-9394-b7e24308c705 Nov 03 08:29:24 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:24 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.8459c448-5aaa-48a4-9394-b7e24308c705" returned: 0 in 0.445s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:29:24 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[11351a6c-e8a2-4cb5-801f-8aeb3b8732e5]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:29:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:24 devstack sudo[103247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c Nov 03 08:29:24 devstack sudo[103247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-6b96f2fa-538c-4095-9e32-57381c2ba74f req-6dd71295-0155-4e4c-b7f3-45ad30680d88 tempest-TestInstancesWithCinderVolumes-1629266108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:29:24 devstack sudo[103247]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c" returned: 0 in 0.392s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 08:29:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Creating direct copy from snapshot {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 08:29:24 devstack cinder-volume[86801]: DEBUG cinder.utils [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Path /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-85272482-48bd-4ea6-a840-b24e4caf786e not found in is_blk_device check {{(pid=86801) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 08:29:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-85272482-48bd-4ea6-a840-b24e4caf786e {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:25 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-85272482-48bd-4ea6-a840-b24e4caf786e Nov 03 08:29:25 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:32 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-85272482-48bd-4ea6-a840-b24e4caf786e" returned: 0 in 7.135s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:32 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c, size 1024.00 MB, duration 7.14 sec, destination /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-85272482-48bd-4ea6-a840-b24e4caf786e {{(pid=86801) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 08:29:32 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Converted 1024.00 MB image at 143.49 MB/s Nov 03 08:29:32 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-85272482-48bd-4ea6-a840-b24e4caf786e is being set with open permissions: ugo+rw Nov 03 08:29:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-85272482-48bd-4ea6-a840-b24e4caf786e {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:32 devstack sudo[103267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-85272482-48bd-4ea6-a840-b24e4caf786e Nov 03 08:29:32 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:32 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-85272482-48bd-4ea6-a840-b24e4caf786e" returned: 0 in 0.235s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:32 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Lock "cinder-quobyte-85272482-48bd-4ea6-a840-b24e4caf786e" released by "_copy_volume_from_snapshot" :: held 8.313s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:29:32 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Lock "cinder-quobyte-8459c448-5aaa-48a4-9394-b7e24308c705-85272482-48bd-4ea6-a840-b24e4caf786e" released by "_create_volume_from_snapshot" :: held 8.390s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:29:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.421s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:29:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-6b96f2fa-538c-4095-9e32-57381c2ba74f req-6dd71295-0155-4e4c-b7f3-45ad30680d88 tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.679s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:29:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-6b96f2fa-538c-4095-9e32-57381c2ba74f req-6dd71295-0155-4e4c-b7f3-45ad30680d88 tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:29:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520fa4d6-50ea-4bcd-b636-13c6360a87fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85272482-48bd-4ea6-a840-b24e4caf786e', 'volume_size': 1, 'snapshot_id': '8459c448-5aaa-48a4-9394-b7e24308c705'}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:29:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3794a2b-18aa-4e52-a2ff-b1178db332fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:29:32 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Volume volume-85272482-48bd-4ea6-a840-b24e4caf786e (85272482-48bd-4ea6-a840-b24e4caf786e): created successfully Nov 03 08:29:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3794a2b-18aa-4e52-a2ff-b1178db332fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:29:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Flow 'volume_create_manager' (b6ad48d1-635c-44b4-87af-36e657cba2b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:29:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-6b96f2fa-538c-4095-9e32-57381c2ba74f req-6dd71295-0155-4e4c-b7f3-45ad30680d88 tempest-TestInstancesWithCinderVolumes-1629266108 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f', 'name': 'volume-2f5a597d-7edb-4539-9e31-f10f6a381fd7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9729ab8-412b-4c5b-b699-c32ebd2d63d5', 'enforce_multipath': True} {{(pid=86801) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 08:29:32 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-f30a397a-64ec-44fc-acce-6cb38cfcf92c tempest-SnapshotDependencyTests-1461784332 None] Created volume successfully. Nov 03 08:29:32 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-6b96f2fa-538c-4095-9e32-57381c2ba74f req-6dd71295-0155-4e4c-b7f3-45ad30680d88 tempest-TestInstancesWithCinderVolumes-1629266108 None] attachment_update completed successfully. Nov 03 08:29:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a82031c1-6171-4a8d-bded-ac42f23f47fd tempest-SnapshotDependencyTests-1461784332 None] Acquiring lock "cinder-8459c448-5aaa-48a4-9394-b7e24308c705-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:29:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a82031c1-6171-4a8d-bded-ac42f23f47fd tempest-SnapshotDependencyTests-1461784332 None] Lock "cinder-8459c448-5aaa-48a4-9394-b7e24308c705-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:29:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a82031c1-6171-4a8d-bded-ac42f23f47fd tempest-SnapshotDependencyTests-1461784332 None] Acquiring lock "cinder-quobyte-5eeebfc6-d1c7-432c-8271-3b907a5fe02c" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:29:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a82031c1-6171-4a8d-bded-ac42f23f47fd tempest-SnapshotDependencyTests-1461784332 None] Lock "cinder-quobyte-5eeebfc6-d1c7-432c-8271-3b907a5fe02c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:29:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a82031c1-6171-4a8d-bded-ac42f23f47fd tempest-SnapshotDependencyTests-1461784332 None] Acquiring lock "cinder-quobyte-8459c448-5aaa-48a4-9394-b7e24308c705" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:29:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a82031c1-6171-4a8d-bded-ac42f23f47fd tempest-SnapshotDependencyTests-1461784332 None] Lock "cinder-quobyte-8459c448-5aaa-48a4-9394-b7e24308c705" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:29:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-a82031c1-6171-4a8d-bded-ac42f23f47fd tempest-SnapshotDependencyTests-1461784332 None] Deleting offline snapshot 8459c448-5aaa-48a4-9394-b7e24308c705 of volume 5eeebfc6-d1c7-432c-8271-3b907a5fe02c {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:29:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-a82031c1-6171-4a8d-bded-ac42f23f47fd tempest-SnapshotDependencyTests-1461784332 None] snapshot_file for this snap is: volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.8459c448-5aaa-48a4-9394-b7e24308c705 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:29:33 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[3916a789-a0e4-4102-8485-35b5120c0a9a]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:29:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a82031c1-6171-4a8d-bded-ac42f23f47fd tempest-SnapshotDependencyTests-1461784332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.8459c448-5aaa-48a4-9394-b7e24308c705 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:33 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.8459c448-5aaa-48a4-9394-b7e24308c705 Nov 03 08:29:33 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:34 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a82031c1-6171-4a8d-bded-ac42f23f47fd tempest-SnapshotDependencyTests-1461784332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.8459c448-5aaa-48a4-9394-b7e24308c705" returned: 0 in 0.364s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:34 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-a82031c1-6171-4a8d-bded-ac42f23f47fd tempest-SnapshotDependencyTests-1461784332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:29:34 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff16ee1-ed97-4c94-92ce-c3184b85ef2c]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:29:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a82031c1-6171-4a8d-bded-ac42f23f47fd tempest-SnapshotDependencyTests-1461784332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:34 devstack sudo[103286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c Nov 03 08:29:34 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:34 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a82031c1-6171-4a8d-bded-ac42f23f47fd tempest-SnapshotDependencyTests-1461784332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c" returned: 0 in 0.559s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a82031c1-6171-4a8d-bded-ac42f23f47fd tempest-SnapshotDependencyTests-1461784332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.8459c448-5aaa-48a4-9394-b7e24308c705 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:34 devstack sudo[103291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.8459c448-5aaa-48a4-9394-b7e24308c705 Nov 03 08:29:34 devstack sudo[103291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:35 devstack sudo[103291]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a82031c1-6171-4a8d-bded-ac42f23f47fd tempest-SnapshotDependencyTests-1461784332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.8459c448-5aaa-48a4-9394-b7e24308c705" returned: 0 in 0.352s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a82031c1-6171-4a8d-bded-ac42f23f47fd tempest-SnapshotDependencyTests-1461784332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.8459c448-5aaa-48a4-9394-b7e24308c705 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:35 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.8459c448-5aaa-48a4-9394-b7e24308c705 Nov 03 08:29:35 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:35 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a82031c1-6171-4a8d-bded-ac42f23f47fd tempest-SnapshotDependencyTests-1461784332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c.8459c448-5aaa-48a4-9394-b7e24308c705" returned: 0 in 0.268s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a82031c1-6171-4a8d-bded-ac42f23f47fd tempest-SnapshotDependencyTests-1461784332 None] Lock "cinder-quobyte-8459c448-5aaa-48a4-9394-b7e24308c705" released by "_delete_snapshot" :: held 1.663s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:29:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a82031c1-6171-4a8d-bded-ac42f23f47fd tempest-SnapshotDependencyTests-1461784332 None] Lock "cinder-quobyte-5eeebfc6-d1c7-432c-8271-3b907a5fe02c" released by "delete_snapshot" :: held 1.684s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:29:35 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-a82031c1-6171-4a8d-bded-ac42f23f47fd tempest-SnapshotDependencyTests-1461784332 None] Created reservations ['51b4a82f-15a6-4ffe-b4a9-e32b25f6ba69', 'df8badbf-91cf-4fd1-96e5-15a851a8a6da', 'b92b495a-d622-4e39-8b30-c467d5672f36', 'fef61ce0-e35e-479d-80dd-190719e79dad'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:29:35 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-a82031c1-6171-4a8d-bded-ac42f23f47fd tempest-SnapshotDependencyTests-1461784332 None] Delete snapshot completed successfully. Nov 03 08:29:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a82031c1-6171-4a8d-bded-ac42f23f47fd tempest-SnapshotDependencyTests-1461784332 None] Lock "cinder-8459c448-5aaa-48a4-9394-b7e24308c705-delete_snapshot" released by "delete_snapshot" :: held 1.832s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:29:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-025891c2-3db6-482d-b68d-66d12a35b822 tempest-SnapshotDependencyTests-1461784332 None] Acquiring lock "cinder-5eeebfc6-d1c7-432c-8271-3b907a5fe02c-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:29:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-025891c2-3db6-482d-b68d-66d12a35b822 tempest-SnapshotDependencyTests-1461784332 None] Lock "cinder-5eeebfc6-d1c7-432c-8271-3b907a5fe02c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:29:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-025891c2-3db6-482d-b68d-66d12a35b822 tempest-SnapshotDependencyTests-1461784332 None] Acquiring lock "cinder-quobyte-5eeebfc6-d1c7-432c-8271-3b907a5fe02c" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:29:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-025891c2-3db6-482d-b68d-66d12a35b822 tempest-SnapshotDependencyTests-1461784332 None] Lock "cinder-quobyte-5eeebfc6-d1c7-432c-8271-3b907a5fe02c" acquired by "delete_volume" :: waited 0.022s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:29:35 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[5baa45cd-e2d2-44f0-bbcf-82b618772808]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:29:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-025891c2-3db6-482d-b68d-66d12a35b822 tempest-SnapshotDependencyTests-1461784332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:36 devstack sudo[103315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c Nov 03 08:29:36 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:36 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-025891c2-3db6-482d-b68d-66d12a35b822 tempest-SnapshotDependencyTests-1461784332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c" returned: 0 in 0.381s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-025891c2-3db6-482d-b68d-66d12a35b822 tempest-SnapshotDependencyTests-1461784332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:36 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c Nov 03 08:29:36 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:36 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-025891c2-3db6-482d-b68d-66d12a35b822 tempest-SnapshotDependencyTests-1461784332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5eeebfc6-d1c7-432c-8271-3b907a5fe02c" returned: 0 in 0.271s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-025891c2-3db6-482d-b68d-66d12a35b822 tempest-SnapshotDependencyTests-1461784332 None] Lock "cinder-quobyte-5eeebfc6-d1c7-432c-8271-3b907a5fe02c" released by "delete_volume" :: held 0.713s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:29:36 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-025891c2-3db6-482d-b68d-66d12a35b822 tempest-SnapshotDependencyTests-1461784332 None] Created reservations ['39dee682-7ca4-4064-8b19-60a1577a4d6a', '8f41c157-f2b3-48de-8ff3-1ee5d9cdedef', '05ce055a-6842-42ef-b6c5-b50bf034d396', '9e5d26e0-b676-4946-9625-b7753814c2c0'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:29:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-025891c2-3db6-482d-b68d-66d12a35b822 tempest-SnapshotDependencyTests-1461784332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:29:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-025891c2-3db6-482d-b68d-66d12a35b822 tempest-SnapshotDependencyTests-1461784332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:29:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-025891c2-3db6-482d-b68d-66d12a35b822 tempest-SnapshotDependencyTests-1461784332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:29:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-025891c2-3db6-482d-b68d-66d12a35b822 tempest-SnapshotDependencyTests-1461784332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:29:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-025891c2-3db6-482d-b68d-66d12a35b822 tempest-SnapshotDependencyTests-1461784332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:29:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-025891c2-3db6-482d-b68d-66d12a35b822 tempest-SnapshotDependencyTests-1461784332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:36 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:29:36 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:36 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-46245406-c7c3-4ddd-8d73-0241b1877039 req-1e3df6e5-01f9-44c5-af2c-0a8a03f36727 tempest-TestInstancesWithCinderVolumes-1629266108 None] Terminate volume connection completed successfully. Nov 03 08:29:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-46245406-c7c3-4ddd-8d73-0241b1877039 req-1e3df6e5-01f9-44c5-af2c-0a8a03f36727 tempest-TestInstancesWithCinderVolumes-1629266108 None] Deleting attachment 43313f6b-75cf-4c5d-86cc-46820a0e1169. {{(pid=86801) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 08:29:36 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-025891c2-3db6-482d-b68d-66d12a35b822 tempest-SnapshotDependencyTests-1461784332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.258s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:36 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-025891c2-3db6-482d-b68d-66d12a35b822 tempest-SnapshotDependencyTests-1461784332 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:29:36 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-025891c2-3db6-482d-b68d-66d12a35b822 tempest-SnapshotDependencyTests-1461784332 None] Deleted volume successfully. Nov 03 08:29:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8e82a48b-c098-480c-8507-479897b3c3de tempest-SnapshotDependencyTests-1461784332 None] Acquiring lock "cinder-85272482-48bd-4ea6-a840-b24e4caf786e-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:29:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-025891c2-3db6-482d-b68d-66d12a35b822 tempest-SnapshotDependencyTests-1461784332 None] Lock "cinder-5eeebfc6-d1c7-432c-8271-3b907a5fe02c-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:29:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8e82a48b-c098-480c-8507-479897b3c3de tempest-SnapshotDependencyTests-1461784332 None] Lock "cinder-85272482-48bd-4ea6-a840-b24e4caf786e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:29:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8e82a48b-c098-480c-8507-479897b3c3de tempest-SnapshotDependencyTests-1461784332 None] Acquiring lock "cinder-quobyte-85272482-48bd-4ea6-a840-b24e4caf786e" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:29:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8e82a48b-c098-480c-8507-479897b3c3de tempest-SnapshotDependencyTests-1461784332 None] Lock "cinder-quobyte-85272482-48bd-4ea6-a840-b24e4caf786e" acquired by "delete_volume" :: waited 0.017s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:29:37 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1acbb5-8ce1-46f4-9f11-dd252675a792]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:29:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8e82a48b-c098-480c-8507-479897b3c3de tempest-SnapshotDependencyTests-1461784332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-85272482-48bd-4ea6-a840-b24e4caf786e {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:37 devstack sudo[103335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-85272482-48bd-4ea6-a840-b24e4caf786e Nov 03 08:29:37 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:37 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8e82a48b-c098-480c-8507-479897b3c3de tempest-SnapshotDependencyTests-1461784332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-85272482-48bd-4ea6-a840-b24e4caf786e" returned: 0 in 0.404s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8e82a48b-c098-480c-8507-479897b3c3de tempest-SnapshotDependencyTests-1461784332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-85272482-48bd-4ea6-a840-b24e4caf786e {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:37 devstack sudo[103340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-85272482-48bd-4ea6-a840-b24e4caf786e Nov 03 08:29:37 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-2c433220-2618-4d69-93bb-53180447ba5d tempest-TestInstancesWithCinderVolumes-1629266108 None] Acquiring lock "cinder-e4f31846-5f73-4b91-bbc8-0595af258569-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:29:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-2c433220-2618-4d69-93bb-53180447ba5d tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "cinder-e4f31846-5f73-4b91-bbc8-0595af258569-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:29:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-2c433220-2618-4d69-93bb-53180447ba5d tempest-TestInstancesWithCinderVolumes-1629266108 None] Acquiring lock "cinder-quobyte-e4f31846-5f73-4b91-bbc8-0595af258569" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:29:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-2c433220-2618-4d69-93bb-53180447ba5d tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "cinder-quobyte-e4f31846-5f73-4b91-bbc8-0595af258569" acquired by "delete_volume" :: waited 0.020s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:29:37 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf21a330-9b02-4108-a6c3-1fe9eb2a34ef]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:29:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2c433220-2618-4d69-93bb-53180447ba5d tempest-TestInstancesWithCinderVolumes-1629266108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e4f31846-5f73-4b91-bbc8-0595af258569 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:37 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8e82a48b-c098-480c-8507-479897b3c3de tempest-SnapshotDependencyTests-1461784332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-85272482-48bd-4ea6-a840-b24e4caf786e" returned: 0 in 0.312s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8e82a48b-c098-480c-8507-479897b3c3de tempest-SnapshotDependencyTests-1461784332 None] Lock "cinder-quobyte-85272482-48bd-4ea6-a840-b24e4caf786e" released by "delete_volume" :: held 0.770s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:29:37 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-8e82a48b-c098-480c-8507-479897b3c3de tempest-SnapshotDependencyTests-1461784332 None] Created reservations ['c3954690-4ec9-4a47-8543-fee22ea11ec1', '08639fb0-510c-49d0-92e1-b14b52b5cc11', '9e8f0f38-cd60-4cb0-851d-c62c852ba968', '6ccff5c3-d527-40df-9772-12f500865a77'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:29:37 devstack sudo[103347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e4f31846-5f73-4b91-bbc8-0595af258569 Nov 03 08:29:37 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8e82a48b-c098-480c-8507-479897b3c3de tempest-SnapshotDependencyTests-1461784332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:29:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8e82a48b-c098-480c-8507-479897b3c3de tempest-SnapshotDependencyTests-1461784332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:29:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8e82a48b-c098-480c-8507-479897b3c3de tempest-SnapshotDependencyTests-1461784332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:29:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8e82a48b-c098-480c-8507-479897b3c3de tempest-SnapshotDependencyTests-1461784332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:29:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8e82a48b-c098-480c-8507-479897b3c3de tempest-SnapshotDependencyTests-1461784332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:29:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8e82a48b-c098-480c-8507-479897b3c3de tempest-SnapshotDependencyTests-1461784332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:38 devstack sudo[103349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:29:38 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:38 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8e82a48b-c098-480c-8507-479897b3c3de tempest-SnapshotDependencyTests-1461784332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.297s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:38 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-8e82a48b-c098-480c-8507-479897b3c3de tempest-SnapshotDependencyTests-1461784332 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:29:38 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-8e82a48b-c098-480c-8507-479897b3c3de tempest-SnapshotDependencyTests-1461784332 None] Deleted volume successfully. Nov 03 08:29:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8e82a48b-c098-480c-8507-479897b3c3de tempest-SnapshotDependencyTests-1461784332 None] Lock "cinder-85272482-48bd-4ea6-a840-b24e4caf786e-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:29:38 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2c433220-2618-4d69-93bb-53180447ba5d tempest-TestInstancesWithCinderVolumes-1629266108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e4f31846-5f73-4b91-bbc8-0595af258569" returned: 0 in 0.552s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2c433220-2618-4d69-93bb-53180447ba5d tempest-TestInstancesWithCinderVolumes-1629266108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e4f31846-5f73-4b91-bbc8-0595af258569 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:38 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e4f31846-5f73-4b91-bbc8-0595af258569 Nov 03 08:29:38 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:38 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2c433220-2618-4d69-93bb-53180447ba5d tempest-TestInstancesWithCinderVolumes-1629266108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e4f31846-5f73-4b91-bbc8-0595af258569" returned: 0 in 0.289s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-2c433220-2618-4d69-93bb-53180447ba5d tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "cinder-quobyte-e4f31846-5f73-4b91-bbc8-0595af258569" released by "delete_volume" :: held 0.909s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:29:38 devstack cinder-volume[86801]: WARNING cinder.quota [None req-2c433220-2618-4d69-93bb-53180447ba5d tempest-TestInstancesWithCinderVolumes-1629266108 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2102410321-1924568588 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2102410321-1924568588, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:29:38 devstack cinder-volume[86801]: WARNING cinder.quota [None req-2c433220-2618-4d69-93bb-53180447ba5d tempest-TestInstancesWithCinderVolumes-1629266108 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2102410321-1924568588 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2102410321-1924568588, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:29:38 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-2c433220-2618-4d69-93bb-53180447ba5d tempest-TestInstancesWithCinderVolumes-1629266108 None] Created reservations ['37aa5d29-dcbf-4eba-b3bc-3fc1e6b57c5e', 'adbaed15-712b-4b06-9471-d0ace8058cf1', '7165dbf9-7c55-40ab-8941-f8e334f3a9c1', '4987da9c-21d6-482b-b444-4c7736eafc03'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:29:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2c433220-2618-4d69-93bb-53180447ba5d tempest-TestInstancesWithCinderVolumes-1629266108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:29:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2c433220-2618-4d69-93bb-53180447ba5d tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:29:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2c433220-2618-4d69-93bb-53180447ba5d tempest-TestInstancesWithCinderVolumes-1629266108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:29:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2c433220-2618-4d69-93bb-53180447ba5d tempest-TestInstancesWithCinderVolumes-1629266108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:29:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2c433220-2618-4d69-93bb-53180447ba5d tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:29:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2c433220-2618-4d69-93bb-53180447ba5d tempest-TestInstancesWithCinderVolumes-1629266108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:38 devstack sudo[103358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:29:38 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:39 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2c433220-2618-4d69-93bb-53180447ba5d tempest-TestInstancesWithCinderVolumes-1629266108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.291s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:39 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-2c433220-2618-4d69-93bb-53180447ba5d tempest-TestInstancesWithCinderVolumes-1629266108 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:29:39 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-2c433220-2618-4d69-93bb-53180447ba5d tempest-TestInstancesWithCinderVolumes-1629266108 None] Deleted volume successfully. Nov 03 08:29:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-2c433220-2618-4d69-93bb-53180447ba5d tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "cinder-e4f31846-5f73-4b91-bbc8-0595af258569-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:29:41 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-31ce158e-7551-44b3-bc99-14ab33c3cdb7 req-8db0296b-a5f0-4364-b261-83e1a7689f5d tempest-TestInstancesWithCinderVolumes-1629266108 None] Terminate volume connection completed successfully. Nov 03 08:29:41 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-31ce158e-7551-44b3-bc99-14ab33c3cdb7 req-8db0296b-a5f0-4364-b261-83e1a7689f5d tempest-TestInstancesWithCinderVolumes-1629266108 None] Deleting attachment f9729ab8-412b-4c5b-b699-c32ebd2d63d5. {{(pid=86801) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 08:29:42 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-e15369e6-353c-4f03-9a3a-2d3b1bc6f2d4 req-9c3066ed-c25c-48f7-acbd-fb99d711327e tempest-TestShelveInstance-695935799 None] Terminate volume connection completed successfully. Nov 03 08:29:42 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-e15369e6-353c-4f03-9a3a-2d3b1bc6f2d4 req-9c3066ed-c25c-48f7-acbd-fb99d711327e tempest-TestShelveInstance-695935799 None] Deleting attachment 64927ca4-a326-4b10-a1e3-b421ea9f6374. {{(pid=86801) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 08:29:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-980650a9-2800-4c2d-b2bd-2381811c6f48 tempest-TestInstancesWithCinderVolumes-1629266108 None] Acquiring lock "cinder-2f5a597d-7edb-4539-9e31-f10f6a381fd7-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:29:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-980650a9-2800-4c2d-b2bd-2381811c6f48 tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "cinder-2f5a597d-7edb-4539-9e31-f10f6a381fd7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:29:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-980650a9-2800-4c2d-b2bd-2381811c6f48 tempest-TestInstancesWithCinderVolumes-1629266108 None] Acquiring lock "cinder-quobyte-2f5a597d-7edb-4539-9e31-f10f6a381fd7" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:29:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-980650a9-2800-4c2d-b2bd-2381811c6f48 tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "cinder-quobyte-2f5a597d-7edb-4539-9e31-f10f6a381fd7" acquired by "delete_volume" :: waited 0.030s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:29:42 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e427a73-b9a4-4658-89af-3c3a98a48a9a]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:29:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-980650a9-2800-4c2d-b2bd-2381811c6f48 tempest-TestInstancesWithCinderVolumes-1629266108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2f5a597d-7edb-4539-9e31-f10f6a381fd7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:42 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2f5a597d-7edb-4539-9e31-f10f6a381fd7 Nov 03 08:29:42 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:43 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-980650a9-2800-4c2d-b2bd-2381811c6f48 tempest-TestInstancesWithCinderVolumes-1629266108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2f5a597d-7edb-4539-9e31-f10f6a381fd7" returned: 0 in 0.515s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-980650a9-2800-4c2d-b2bd-2381811c6f48 tempest-TestInstancesWithCinderVolumes-1629266108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2f5a597d-7edb-4539-9e31-f10f6a381fd7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:43 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2f5a597d-7edb-4539-9e31-f10f6a381fd7 Nov 03 08:29:43 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:43 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-980650a9-2800-4c2d-b2bd-2381811c6f48 tempest-TestInstancesWithCinderVolumes-1629266108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2f5a597d-7edb-4539-9e31-f10f6a381fd7" returned: 0 in 0.338s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-980650a9-2800-4c2d-b2bd-2381811c6f48 tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "cinder-quobyte-2f5a597d-7edb-4539-9e31-f10f6a381fd7" released by "delete_volume" :: held 0.922s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:29:43 devstack cinder-volume[86801]: WARNING cinder.quota [None req-980650a9-2800-4c2d-b2bd-2381811c6f48 tempest-TestInstancesWithCinderVolumes-1629266108 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1240611250-174259270 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1240611250-174259270, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:29:43 devstack cinder-volume[86801]: WARNING cinder.quota [None req-980650a9-2800-4c2d-b2bd-2381811c6f48 tempest-TestInstancesWithCinderVolumes-1629266108 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1240611250-174259270 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1240611250-174259270, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:29:43 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-980650a9-2800-4c2d-b2bd-2381811c6f48 tempest-TestInstancesWithCinderVolumes-1629266108 None] Created reservations ['b835ec7c-e8ce-4b8a-ba3a-fd61963191d3', '98d40b4a-60dc-4400-8ff9-37d9bf91f6b0', 'fc1857d9-c412-48dc-bc90-ee27781f56b4', '52343f01-e117-4cbe-b976-b177f5b339fc'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:29:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-980650a9-2800-4c2d-b2bd-2381811c6f48 tempest-TestInstancesWithCinderVolumes-1629266108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:29:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-980650a9-2800-4c2d-b2bd-2381811c6f48 tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:29:43 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-980650a9-2800-4c2d-b2bd-2381811c6f48 tempest-TestInstancesWithCinderVolumes-1629266108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:29:43 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-980650a9-2800-4c2d-b2bd-2381811c6f48 tempest-TestInstancesWithCinderVolumes-1629266108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:29:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-980650a9-2800-4c2d-b2bd-2381811c6f48 tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:29:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-980650a9-2800-4c2d-b2bd-2381811c6f48 tempest-TestInstancesWithCinderVolumes-1629266108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:43 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:29:43 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:44 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-980650a9-2800-4c2d-b2bd-2381811c6f48 tempest-TestInstancesWithCinderVolumes-1629266108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.323s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:44 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-980650a9-2800-4c2d-b2bd-2381811c6f48 tempest-TestInstancesWithCinderVolumes-1629266108 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:29:44 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-980650a9-2800-4c2d-b2bd-2381811c6f48 tempest-TestInstancesWithCinderVolumes-1629266108 None] Deleted volume successfully. Nov 03 08:29:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-980650a9-2800-4c2d-b2bd-2381811c6f48 tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "cinder-2f5a597d-7edb-4539-9e31-f10f6a381fd7-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:29:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-e703ac24-4936-4eb6-8185-adc54f1a9f18 req-a7bfbcec-0454-4798-89e3-1397a1fc2d8f tempest-TestShelveInstance-695935799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:29:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-e703ac24-4936-4eb6-8185-adc54f1a9f18 req-a7bfbcec-0454-4798-89e3-1397a1fc2d8f tempest-TestShelveInstance-695935799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:29:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-e703ac24-4936-4eb6-8185-adc54f1a9f18 req-a7bfbcec-0454-4798-89e3-1397a1fc2d8f tempest-TestShelveInstance-695935799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:29:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-e703ac24-4936-4eb6-8185-adc54f1a9f18 req-a7bfbcec-0454-4798-89e3-1397a1fc2d8f tempest-TestShelveInstance-695935799 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f', 'name': 'volume-153e5137-ecb9-4698-9c07-d62e2dba1842', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '48254939-bf48-41e5-bca4-2225ad94ebcc', 'enforce_multipath': True} {{(pid=86801) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 08:29:47 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-e703ac24-4936-4eb6-8185-adc54f1a9f18 req-a7bfbcec-0454-4798-89e3-1397a1fc2d8f tempest-TestShelveInstance-695935799 None] attachment_update completed successfully. Nov 03 08:29:47 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-bf0ba91d-ebc9-4795-91f2-0da7057e2cad req-63f3c793-8faf-46e6-8af8-9a0660c29a0c tempest-TestInstancesWithCinderVolumes-1629266108 None] Terminate volume connection completed successfully. Nov 03 08:29:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-bf0ba91d-ebc9-4795-91f2-0da7057e2cad req-63f3c793-8faf-46e6-8af8-9a0660c29a0c tempest-TestInstancesWithCinderVolumes-1629266108 None] Deleting attachment f3e1d3ca-a70c-44d4-bad6-f4c1c95637c0. {{(pid=86801) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 08:29:48 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8227add4-f97d-443c-bc66-1d70601e1ccb tempest-TestInstancesWithCinderVolumes-1629266108 None] Acquiring lock "cinder-8f5909a9-8252-4da6-b393-c8ef910ec39d-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:29:48 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8227add4-f97d-443c-bc66-1d70601e1ccb tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "cinder-8f5909a9-8252-4da6-b393-c8ef910ec39d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:29:48 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8227add4-f97d-443c-bc66-1d70601e1ccb tempest-TestInstancesWithCinderVolumes-1629266108 None] Acquiring lock "cinder-quobyte-8f5909a9-8252-4da6-b393-c8ef910ec39d" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:29:48 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8227add4-f97d-443c-bc66-1d70601e1ccb tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "cinder-quobyte-8f5909a9-8252-4da6-b393-c8ef910ec39d" acquired by "delete_volume" :: waited 0.029s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:29:48 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7beb8ec-bcc6-4185-ba41-ead9242bf48d]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:29:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8227add4-f97d-443c-bc66-1d70601e1ccb tempest-TestInstancesWithCinderVolumes-1629266108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8f5909a9-8252-4da6-b393-c8ef910ec39d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:48 devstack sudo[103472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8f5909a9-8252-4da6-b393-c8ef910ec39d Nov 03 08:29:48 devstack sudo[103472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:49 devstack sudo[103472]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8227add4-f97d-443c-bc66-1d70601e1ccb tempest-TestInstancesWithCinderVolumes-1629266108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8f5909a9-8252-4da6-b393-c8ef910ec39d" returned: 0 in 0.426s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8227add4-f97d-443c-bc66-1d70601e1ccb tempest-TestInstancesWithCinderVolumes-1629266108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8f5909a9-8252-4da6-b393-c8ef910ec39d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:49 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8f5909a9-8252-4da6-b393-c8ef910ec39d Nov 03 08:29:49 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:49 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8227add4-f97d-443c-bc66-1d70601e1ccb tempest-TestInstancesWithCinderVolumes-1629266108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8f5909a9-8252-4da6-b393-c8ef910ec39d" returned: 0 in 0.334s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:49 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8227add4-f97d-443c-bc66-1d70601e1ccb tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "cinder-quobyte-8f5909a9-8252-4da6-b393-c8ef910ec39d" released by "delete_volume" :: held 0.818s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:29:49 devstack cinder-volume[86801]: WARNING cinder.quota [None req-8227add4-f97d-443c-bc66-1d70601e1ccb tempest-TestInstancesWithCinderVolumes-1629266108 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-790428714-1093018088 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-790428714-1093018088, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:29:49 devstack cinder-volume[86801]: WARNING cinder.quota [None req-8227add4-f97d-443c-bc66-1d70601e1ccb tempest-TestInstancesWithCinderVolumes-1629266108 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-790428714-1093018088 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-790428714-1093018088, it is now deprecated. Please use the default quota class for default quota. Nov 03 08:29:49 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-8227add4-f97d-443c-bc66-1d70601e1ccb tempest-TestInstancesWithCinderVolumes-1629266108 None] Created reservations ['18deed9d-f45d-4001-98a8-514d20b271cc', '250e4ec5-1c75-416f-8b8c-1955a430db6b', '5ca50ea6-f2c2-4f38-879a-26d5a8aaa6f4', '236133af-7ac5-47e1-be6f-1a21a4e8313b'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:29:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8227add4-f97d-443c-bc66-1d70601e1ccb tempest-TestInstancesWithCinderVolumes-1629266108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:29:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8227add4-f97d-443c-bc66-1d70601e1ccb tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:29:49 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8227add4-f97d-443c-bc66-1d70601e1ccb tempest-TestInstancesWithCinderVolumes-1629266108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:29:49 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8227add4-f97d-443c-bc66-1d70601e1ccb tempest-TestInstancesWithCinderVolumes-1629266108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:29:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8227add4-f97d-443c-bc66-1d70601e1ccb tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:29:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8227add4-f97d-443c-bc66-1d70601e1ccb tempest-TestInstancesWithCinderVolumes-1629266108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:29:49 devstack sudo[103482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:29:49 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:29:50 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root Nov 03 08:29:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8227add4-f97d-443c-bc66-1d70601e1ccb tempest-TestInstancesWithCinderVolumes-1629266108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.345s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:29:50 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-8227add4-f97d-443c-bc66-1d70601e1ccb tempest-TestInstancesWithCinderVolumes-1629266108 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:29:50 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-8227add4-f97d-443c-bc66-1d70601e1ccb tempest-TestInstancesWithCinderVolumes-1629266108 None] Deleted volume successfully. Nov 03 08:29:50 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8227add4-f97d-443c-bc66-1d70601e1ccb tempest-TestInstancesWithCinderVolumes-1629266108 None] Lock "cinder-8f5909a9-8252-4da6-b393-c8ef910ec39d-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:29:59 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=50,cinder:UPDATE=52,cinder:DELETE=2,cinder:INSERT=12 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:30:00 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=66,cinder:UPDATE=56,cinder:INSERT=14,cinder:DELETE=5 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:30:03 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:30:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:30:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:30:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:30:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:30:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:30:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:30:03 devstack sudo[103980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:30:03 devstack sudo[103980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:30:04 devstack sudo[103980]: pam_unix(sudo:session): session closed for user root Nov 03 08:30:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.290s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:30:04 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:30:04 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager._thread_info {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:30:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread count: 29 {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 08:30:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread info: [<_MainThread(MainThread, started 139707544170624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 08:30:17 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-3b396283-36ee-4c17-af67-b3cba369ace5 req-de4b6d2e-f1af-4aa6-85b5-23471f8cbf71 tempest-TestShelveInstance-695935799 None] Terminate volume connection completed successfully. Nov 03 08:30:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-3b396283-36ee-4c17-af67-b3cba369ace5 req-de4b6d2e-f1af-4aa6-85b5-23471f8cbf71 tempest-TestShelveInstance-695935799 None] Deleting attachment 48254939-bf48-41e5-bca4-2225ad94ebcc. {{(pid=86801) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 08:30:17 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-3b396283-36ee-4c17-af67-b3cba369ace5 req-c9703d0c-7c5b-4bcc-8922-3d86b6d1af9d tempest-TestShelveInstance-695935799 None] Acquiring lock "cinder-153e5137-ecb9-4698-9c07-d62e2dba1842-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:30:17 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-3b396283-36ee-4c17-af67-b3cba369ace5 req-c9703d0c-7c5b-4bcc-8922-3d86b6d1af9d tempest-TestShelveInstance-695935799 None] Lock "cinder-153e5137-ecb9-4698-9c07-d62e2dba1842-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:30:17 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-3b396283-36ee-4c17-af67-b3cba369ace5 req-c9703d0c-7c5b-4bcc-8922-3d86b6d1af9d tempest-TestShelveInstance-695935799 None] Acquiring lock "cinder-quobyte-153e5137-ecb9-4698-9c07-d62e2dba1842" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:30:17 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-3b396283-36ee-4c17-af67-b3cba369ace5 req-c9703d0c-7c5b-4bcc-8922-3d86b6d1af9d tempest-TestShelveInstance-695935799 None] Lock "cinder-quobyte-153e5137-ecb9-4698-9c07-d62e2dba1842" acquired by "delete_volume" :: waited 0.024s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:30:17 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f89423f-ee2b-418e-90ee-db2fd0514bf2]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:30:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-3b396283-36ee-4c17-af67-b3cba369ace5 req-c9703d0c-7c5b-4bcc-8922-3d86b6d1af9d tempest-TestShelveInstance-695935799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-153e5137-ecb9-4698-9c07-d62e2dba1842 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:30:17 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-153e5137-ecb9-4698-9c07-d62e2dba1842 Nov 03 08:30:17 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:30:17 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Nov 03 08:30:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-3b396283-36ee-4c17-af67-b3cba369ace5 req-c9703d0c-7c5b-4bcc-8922-3d86b6d1af9d tempest-TestShelveInstance-695935799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-153e5137-ecb9-4698-9c07-d62e2dba1842" returned: 0 in 0.399s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:30:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-3b396283-36ee-4c17-af67-b3cba369ace5 req-c9703d0c-7c5b-4bcc-8922-3d86b6d1af9d tempest-TestShelveInstance-695935799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-153e5137-ecb9-4698-9c07-d62e2dba1842 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:30:17 devstack sudo[104103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-153e5137-ecb9-4698-9c07-d62e2dba1842 Nov 03 08:30:17 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:30:18 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root Nov 03 08:30:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-3b396283-36ee-4c17-af67-b3cba369ace5 req-c9703d0c-7c5b-4bcc-8922-3d86b6d1af9d tempest-TestShelveInstance-695935799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-153e5137-ecb9-4698-9c07-d62e2dba1842" returned: 0 in 0.350s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:30:18 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-3b396283-36ee-4c17-af67-b3cba369ace5 req-c9703d0c-7c5b-4bcc-8922-3d86b6d1af9d tempest-TestShelveInstance-695935799 None] Lock "cinder-quobyte-153e5137-ecb9-4698-9c07-d62e2dba1842" released by "delete_volume" :: held 0.816s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:30:18 devstack cinder-volume[86801]: DEBUG cinder.quota [req-3b396283-36ee-4c17-af67-b3cba369ace5 req-c9703d0c-7c5b-4bcc-8922-3d86b6d1af9d tempest-TestShelveInstance-695935799 None] Created reservations ['0c3fc0cb-1d94-459f-b19d-932a90511fdb', '23bde5c9-1ad4-4790-9df9-6fd27603c6c4', 'a010e894-42ee-445a-88fa-cba4af8beabe', '6558c680-b3ef-4daa-a965-6d547fdbf731'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:30:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-3b396283-36ee-4c17-af67-b3cba369ace5 req-c9703d0c-7c5b-4bcc-8922-3d86b6d1af9d tempest-TestShelveInstance-695935799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:30:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-3b396283-36ee-4c17-af67-b3cba369ace5 req-c9703d0c-7c5b-4bcc-8922-3d86b6d1af9d tempest-TestShelveInstance-695935799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:30:18 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [req-3b396283-36ee-4c17-af67-b3cba369ace5 req-c9703d0c-7c5b-4bcc-8922-3d86b6d1af9d tempest-TestShelveInstance-695935799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:30:18 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [req-3b396283-36ee-4c17-af67-b3cba369ace5 req-c9703d0c-7c5b-4bcc-8922-3d86b6d1af9d tempest-TestShelveInstance-695935799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:30:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-3b396283-36ee-4c17-af67-b3cba369ace5 req-c9703d0c-7c5b-4bcc-8922-3d86b6d1af9d tempest-TestShelveInstance-695935799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:30:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-3b396283-36ee-4c17-af67-b3cba369ace5 req-c9703d0c-7c5b-4bcc-8922-3d86b6d1af9d tempest-TestShelveInstance-695935799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:30:18 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:30:18 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:30:18 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Nov 03 08:30:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [req-3b396283-36ee-4c17-af67-b3cba369ace5 req-c9703d0c-7c5b-4bcc-8922-3d86b6d1af9d tempest-TestShelveInstance-695935799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.274s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:30:18 devstack cinder-volume[86801]: DEBUG cinder.manager [req-3b396283-36ee-4c17-af67-b3cba369ace5 req-c9703d0c-7c5b-4bcc-8922-3d86b6d1af9d tempest-TestShelveInstance-695935799 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:30:18 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-3b396283-36ee-4c17-af67-b3cba369ace5 req-c9703d0c-7c5b-4bcc-8922-3d86b6d1af9d tempest-TestShelveInstance-695935799 None] Deleted volume successfully. Nov 03 08:30:18 devstack cinder-volume[86801]: DEBUG cinder.coordination [req-3b396283-36ee-4c17-af67-b3cba369ace5 req-c9703d0c-7c5b-4bcc-8922-3d86b6d1af9d tempest-TestShelveInstance-695935799 None] Lock "cinder-153e5137-ecb9-4698-9c07-d62e2dba1842-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:30:28 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:30:28 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:30:51 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:30:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Flow 'volume_create_manager' (1116ba76-c0db-48d3-90e5-3cc930b51f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:30:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0002aa4-d62b-421c-95a2-384ca1ab50ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:30:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0002aa4-d62b-421c-95a2-384ca1ab50ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1277232651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28645fc-17bb-43a5-a9f6-95c28127e0c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='157ebf41c5e14a08a992a35c84e46144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:30:52Z,use_quota=True,user_id='99bff6a781ad4b0a8dfaa87cf68bbb40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:30:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b088b80f-ee62-485e-8af3-1cd69e9e5512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:30:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b088b80f-ee62-485e-8af3-1cd69e9e5512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:30:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f2afb3c-43b5-4c2b-af1f-e9cd1aba9ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:30:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f2afb3c-43b5-4c2b-af1f-e9cd1aba9ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f28645fc-17bb-43a5-a9f6-95c28127e0c2', 'volume_name': 'volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:30:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff5f3c71-e4b3-4f18-8c8c-c04082e94c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:30:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff5f3c71-e4b3-4f18-8c8c-c04082e94c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:30:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a25eef-b56d-4a97-a68f-b05d17ca02a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:30:51 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Volume f28645fc-17bb-43a5-a9f6-95c28127e0c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2', 'volume_size': 1} Nov 03 08:30:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:30:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:30:51 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1277232651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28645fc-17bb-43a5-a9f6-95c28127e0c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='157ebf41c5e14a08a992a35c84e46144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:30:52Z,use_quota=True,user_id='99bff6a781ad4b0a8dfaa87cf68bbb40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:30:51 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Creating volume f28645fc-17bb-43a5-a9f6-95c28127e0c2 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:30:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:30:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:30:51 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:30:51 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:30:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:30:51 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:30:51 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:30:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:30:51 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2 1073741824 Nov 03 08:30:51 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:30:52 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Nov 03 08:30:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2 1073741824" returned: 0 in 0.434s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:30:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:30:52 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2 Nov 03 08:30:52 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:30:52 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Nov 03 08:30:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2" returned: 0 in 0.258s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:30:52 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:30:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:30:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a25eef-b56d-4a97-a68f-b05d17ca02a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:30:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (501f1a8b-da78-4e09-afd3-176597045b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:30:52 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Volume volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2 (f28645fc-17bb-43a5-a9f6-95c28127e0c2): created successfully Nov 03 08:30:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (501f1a8b-da78-4e09-afd3-176597045b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:30:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Flow 'volume_create_manager' (1116ba76-c0db-48d3-90e5-3cc930b51f8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:30:52 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-1301359e-8bfa-4118-ba23-1ce4dee08c17 tempest-TestImageHashVerification-1893193746 None] Created volume successfully. Nov 03 08:30:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9e1850b0-1352-4843-b1d0-f2a974c28186 tempest-TestImageHashVerification-1893193746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:30:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9e1850b0-1352-4843-b1d0-f2a974c28186 tempest-TestImageHashVerification-1893193746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:30:54 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edef0c3-e900-4281-b2d4-a544c75eeadb]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:30:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9e1850b0-1352-4843-b1d0-f2a974c28186 tempest-TestImageHashVerification-1893193746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:30:54 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2 Nov 03 08:30:54 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:30:54 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:30:54 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Nov 03 08:30:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Flow 'volume_create_manager' (fe7de37b-33b3-4791-acf7-90361e631b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:30:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (154b86db-389f-4b99-8680-bda74e019b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:30:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9e1850b0-1352-4843-b1d0-f2a974c28186 tempest-TestImageHashVerification-1893193746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2" returned: 0 in 0.444s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:30:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (154b86db-389f-4b99-8680-bda74e019b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1300410230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e19a5548-ba51-4a24-823b-2eab7543da23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d479366316245a0b5aa37a02a3bf05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:30:55Z,use_quota=True,user_id='0363df9d5e784073a7cea5998c548ad5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:30:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834675f3-1ae7-4dec-aa29-add143fb7c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:30:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834675f3-1ae7-4dec-aa29-add143fb7c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:30:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0df74fc-8e22-45d5-89f9-a3ba01ed97b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:30:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0df74fc-8e22-45d5-89f9-a3ba01ed97b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e19a5548-ba51-4a24-823b-2eab7543da23', 'volume_name': 'volume-e19a5548-ba51-4a24-823b-2eab7543da23', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:30:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7953b20a-23e7-428d-b099-0ae8efae670a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:30:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7953b20a-23e7-428d-b099-0ae8efae670a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:30:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e965bce-3fa9-4f2d-8a30-a29a228e71ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:30:54 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Volume e19a5548-ba51-4a24-823b-2eab7543da23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e19a5548-ba51-4a24-823b-2eab7543da23', 'volume_size': 1} Nov 03 08:30:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:30:54 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[37643c31-f6ac-4856-a2d1-3f4f6270476c]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:30:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9e1850b0-1352-4843-b1d0-f2a974c28186 tempest-TestImageHashVerification-1893193746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:30:55 devstack sudo[104243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2 Nov 03 08:30:55 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:30:55 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root Nov 03 08:30:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9e1850b0-1352-4843-b1d0-f2a974c28186 tempest-TestImageHashVerification-1893193746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2" returned: 0 in 0.363s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:30:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9e1850b0-1352-4843-b1d0-f2a974c28186 tempest-TestImageHashVerification-1893193746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2 /opt/stack/data/cinder/conversion/f28645fc-17bb-43a5-a9f6-95c28127e0c2.temp_image.d5c69e93-0c62-4af3-b2f0-f20cde83eee99n6374if.img {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:30:55 devstack sudo[104248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2 /opt/stack/data/cinder/conversion/f28645fc-17bb-43a5-a9f6-95c28127e0c2.temp_image.d5c69e93-0c62-4af3-b2f0-f20cde83eee99n6374if.img Nov 03 08:30:55 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:01 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9e1850b0-1352-4843-b1d0-f2a974c28186 tempest-TestImageHashVerification-1893193746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2 /opt/stack/data/cinder/conversion/f28645fc-17bb-43a5-a9f6-95c28127e0c2.temp_image.d5c69e93-0c62-4af3-b2f0-f20cde83eee99n6374if.img" returned: 0 in 5.838s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:01 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf46748-817b-47f3-a19d-4bffa5e3274e]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:31:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9e1850b0-1352-4843-b1d0-f2a974c28186 tempest-TestImageHashVerification-1893193746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:01 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2 Nov 03 08:31:01 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:01 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9e1850b0-1352-4843-b1d0-f2a974c28186 tempest-TestImageHashVerification-1893193746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2" returned: 0 in 0.541s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:01 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-9e1850b0-1352-4843-b1d0-f2a974c28186 tempest-TestImageHashVerification-1893193746 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2, size 1024.00 MB, duration 5.84 sec, destination /opt/stack/data/cinder/conversion/f28645fc-17bb-43a5-a9f6-95c28127e0c2.temp_image.d5c69e93-0c62-4af3-b2f0-f20cde83eee99n6374if.img {{(pid=86801) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 08:31:01 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-9e1850b0-1352-4843-b1d0-f2a974c28186 tempest-TestImageHashVerification-1893193746 None] Converted 1024.00 MB image at 175.36 MB/s Nov 03 08:31:01 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-9e1850b0-1352-4843-b1d0-f2a974c28186 tempest-TestImageHashVerification-1893193746 None] d5c69e93-0c62-4af3-b2f0-f20cde83eee9 was raw, no need to convert to raw {{(pid=86801) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 03 08:31:03 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:31:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:31:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:31:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:03 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:31:03 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:04 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.289s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:04 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:31:04 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager._thread_info {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:31:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread count: 29 {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 08:31:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread info: [<_MainThread(MainThread, started 139707544170624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 08:31:11 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:UPDATE=4,cinder:SELECT=5 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:31:11 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:31:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9e1850b0-1352-4843-b1d0-f2a974c28186 tempest-TestImageHashVerification-1893193746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.327s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-9e1850b0-1352-4843-b1d0-f2a974c28186 tempest-TestImageHashVerification-1893193746 None] Uploaded volume to glance image-id: d5c69e93-0c62-4af3-b2f0-f20cde83eee9. {{(pid=86801) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 08:31:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.818s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:19 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1300410230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e19a5548-ba51-4a24-823b-2eab7543da23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d479366316245a0b5aa37a02a3bf05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:30:55Z,use_quota=True,user_id='0363df9d5e784073a7cea5998c548ad5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:31:19 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Creating volume e19a5548-ba51-4a24-823b-2eab7543da23 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:31:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:19 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:31:19 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:31:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:19 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:31:19 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:31:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e19a5548-ba51-4a24-823b-2eab7543da23 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:19 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-9e1850b0-1352-4843-b1d0-f2a974c28186 tempest-TestImageHashVerification-1893193746 None] Copy volume to image completed successfully. Nov 03 08:31:19 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e19a5548-ba51-4a24-823b-2eab7543da23 1073741824 Nov 03 08:31:19 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:20 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e19a5548-ba51-4a24-823b-2eab7543da23 1073741824" returned: 0 in 0.410s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e19a5548-ba51-4a24-823b-2eab7543da23 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:20 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e19a5548-ba51-4a24-823b-2eab7543da23 Nov 03 08:31:20 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:20 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e19a5548-ba51-4a24-823b-2eab7543da23" returned: 0 in 0.259s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:31:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e965bce-3fa9-4f2d-8a30-a29a228e71ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e19a5548-ba51-4a24-823b-2eab7543da23', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78fac35d-ea64-41d9-aebf-1c680f94a61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:20 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Volume volume-e19a5548-ba51-4a24-823b-2eab7543da23 (e19a5548-ba51-4a24-823b-2eab7543da23): created successfully Nov 03 08:31:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78fac35d-ea64-41d9-aebf-1c680f94a61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Flow 'volume_create_manager' (fe7de37b-33b3-4791-acf7-90361e631b61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:31:20 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-d993b308-c603-4274-a62b-7d12d8767f0e tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Created volume successfully. Nov 03 08:31:20 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-00a7f675-fe81-4714-a3a3-47b1ab240493 tempest-TestImageHashVerification-1893193746 None] Acquiring lock "cinder-f28645fc-17bb-43a5-a9f6-95c28127e0c2-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:31:20 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-00a7f675-fe81-4714-a3a3-47b1ab240493 tempest-TestImageHashVerification-1893193746 None] Lock "cinder-f28645fc-17bb-43a5-a9f6-95c28127e0c2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:31:20 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-00a7f675-fe81-4714-a3a3-47b1ab240493 tempest-TestImageHashVerification-1893193746 None] Acquiring lock "cinder-quobyte-f28645fc-17bb-43a5-a9f6-95c28127e0c2" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:31:20 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-00a7f675-fe81-4714-a3a3-47b1ab240493 tempest-TestImageHashVerification-1893193746 None] Lock "cinder-quobyte-f28645fc-17bb-43a5-a9f6-95c28127e0c2" acquired by "delete_volume" :: waited 0.019s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:31:20 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac690ef-0254-4d49-a4d9-1af29293aa81]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:31:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-00a7f675-fe81-4714-a3a3-47b1ab240493 tempest-TestImageHashVerification-1893193746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:21 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2 Nov 03 08:31:21 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:21 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-00a7f675-fe81-4714-a3a3-47b1ab240493 tempest-TestImageHashVerification-1893193746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2" returned: 0 in 0.388s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-00a7f675-fe81-4714-a3a3-47b1ab240493 tempest-TestImageHashVerification-1893193746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:21 devstack sudo[104336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2 Nov 03 08:31:21 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:21 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-00a7f675-fe81-4714-a3a3-47b1ab240493 tempest-TestImageHashVerification-1893193746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f28645fc-17bb-43a5-a9f6-95c28127e0c2" returned: 0 in 0.295s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:21 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-00a7f675-fe81-4714-a3a3-47b1ab240493 tempest-TestImageHashVerification-1893193746 None] Lock "cinder-quobyte-f28645fc-17bb-43a5-a9f6-95c28127e0c2" released by "delete_volume" :: held 0.735s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:31:21 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-00a7f675-fe81-4714-a3a3-47b1ab240493 tempest-TestImageHashVerification-1893193746 None] Created reservations ['ad76c54a-5c63-4fd9-bf42-3a9e943875c3', 'b22ed029-100b-4833-a71f-9b5aa932bb32', 'e4b03c9c-082e-4ffc-b31e-c0c82cabd41d', 'e364acf3-b72a-4695-8a00-4d36917912e5'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:31:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-00a7f675-fe81-4714-a3a3-47b1ab240493 tempest-TestImageHashVerification-1893193746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-00a7f675-fe81-4714-a3a3-47b1ab240493 tempest-TestImageHashVerification-1893193746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:21 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-00a7f675-fe81-4714-a3a3-47b1ab240493 tempest-TestImageHashVerification-1893193746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:31:21 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-00a7f675-fe81-4714-a3a3-47b1ab240493 tempest-TestImageHashVerification-1893193746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:31:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-00a7f675-fe81-4714-a3a3-47b1ab240493 tempest-TestImageHashVerification-1893193746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-00a7f675-fe81-4714-a3a3-47b1ab240493 tempest-TestImageHashVerification-1893193746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:21 devstack sudo[104342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:31:21 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:22 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-00a7f675-fe81-4714-a3a3-47b1ab240493 tempest-TestImageHashVerification-1893193746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.330s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:22 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-00a7f675-fe81-4714-a3a3-47b1ab240493 tempest-TestImageHashVerification-1893193746 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:31:22 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-00a7f675-fe81-4714-a3a3-47b1ab240493 tempest-TestImageHashVerification-1893193746 None] Deleted volume successfully. Nov 03 08:31:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-00a7f675-fe81-4714-a3a3-47b1ab240493 tempest-TestImageHashVerification-1893193746 None] Lock "cinder-f28645fc-17bb-43a5-a9f6-95c28127e0c2-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:31:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-a80d193f-8cfc-44f6-956d-2db4f64c3d26 req-55dad272-aafe-46b9-86c5-46750fba14f0 tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-a80d193f-8cfc-44f6-956d-2db4f64c3d26 req-55dad272-aafe-46b9-86c5-46750fba14f0 tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [req-a80d193f-8cfc-44f6-956d-2db4f64c3d26 req-55dad272-aafe-46b9-86c5-46750fba14f0 tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-a80d193f-8cfc-44f6-956d-2db4f64c3d26 req-55dad272-aafe-46b9-86c5-46750fba14f0 tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f', 'name': 'volume-e19a5548-ba51-4a24-823b-2eab7543da23', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7644aa0b-6029-445f-acef-3d359baa1808', 'enforce_multipath': True} {{(pid=86801) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 08:31:22 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-a80d193f-8cfc-44f6-956d-2db4f64c3d26 req-55dad272-aafe-46b9-86c5-46750fba14f0 tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] attachment_update completed successfully. Nov 03 08:31:25 devstack cinder-volume[86801]: INFO cinder.volume.manager [req-59da68af-3ea3-49bd-9b7c-02f30ae19bab req-71537585-12f1-47d7-a8f7-f9169f93bbc0 tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Terminate volume connection completed successfully. Nov 03 08:31:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [req-59da68af-3ea3-49bd-9b7c-02f30ae19bab req-71537585-12f1-47d7-a8f7-f9169f93bbc0 tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Deleting attachment 7644aa0b-6029-445f-acef-3d359baa1808. {{(pid=86801) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 08:31:26 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5b697141-f398-40ed-8f98-3c53484f2266 tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Acquiring lock "cinder-e19a5548-ba51-4a24-823b-2eab7543da23-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:31:26 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5b697141-f398-40ed-8f98-3c53484f2266 tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Lock "cinder-e19a5548-ba51-4a24-823b-2eab7543da23-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:31:26 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5b697141-f398-40ed-8f98-3c53484f2266 tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Acquiring lock "cinder-quobyte-e19a5548-ba51-4a24-823b-2eab7543da23" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:31:26 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5b697141-f398-40ed-8f98-3c53484f2266 tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Lock "cinder-quobyte-e19a5548-ba51-4a24-823b-2eab7543da23" acquired by "delete_volume" :: waited 0.014s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:31:26 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff6ad99-6821-4293-94cf-59ba7ba78dc8]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:31:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b697141-f398-40ed-8f98-3c53484f2266 tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e19a5548-ba51-4a24-823b-2eab7543da23 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:26 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e19a5548-ba51-4a24-823b-2eab7543da23 Nov 03 08:31:26 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:26 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b697141-f398-40ed-8f98-3c53484f2266 tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e19a5548-ba51-4a24-823b-2eab7543da23" returned: 0 in 0.414s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b697141-f398-40ed-8f98-3c53484f2266 tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e19a5548-ba51-4a24-823b-2eab7543da23 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:26 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e19a5548-ba51-4a24-823b-2eab7543da23 Nov 03 08:31:26 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:27 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b697141-f398-40ed-8f98-3c53484f2266 tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-e19a5548-ba51-4a24-823b-2eab7543da23" returned: 0 in 0.254s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:27 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5b697141-f398-40ed-8f98-3c53484f2266 tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Lock "cinder-quobyte-e19a5548-ba51-4a24-823b-2eab7543da23" released by "delete_volume" :: held 0.714s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:31:27 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-5b697141-f398-40ed-8f98-3c53484f2266 tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Created reservations ['05adb42b-f519-4f04-8f74-e3ab3139c249', 'cb44f833-7268-44bf-843f-4be6d253b918', '939ff123-bf08-49b4-aa11-88f128c076c9', '6b152f36-e592-47b4-9468-f27d7dced6a6'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:31:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5b697141-f398-40ed-8f98-3c53484f2266 tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5b697141-f398-40ed-8f98-3c53484f2266 tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5b697141-f398-40ed-8f98-3c53484f2266 tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:31:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5b697141-f398-40ed-8f98-3c53484f2266 tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:31:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5b697141-f398-40ed-8f98-3c53484f2266 tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b697141-f398-40ed-8f98-3c53484f2266 tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:27 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:31:27 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:27 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5b697141-f398-40ed-8f98-3c53484f2266 tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.267s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:27 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-5b697141-f398-40ed-8f98-3c53484f2266 tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:31:27 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-5b697141-f398-40ed-8f98-3c53484f2266 tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Deleted volume successfully. Nov 03 08:31:27 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5b697141-f398-40ed-8f98-3c53484f2266 tempest-TestServerVolumeAttachScenarioOldVersion-128257707 None] Lock "cinder-e19a5548-ba51-4a24-823b-2eab7543da23-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Flow 'volume_create_manager' (742fb21a-731c-4039-8bc6-c09ad9a95ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42326a8-80b4-4f00-8c2c-e6ec8ee297d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42326a8-80b4-4f00-8c2c-e6ec8ee297d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-337591848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab7a898f-09d6-46e1-a388-32cd604274ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd2188f776741f7b49608d30acfb9ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:31:35Z,use_quota=True,user_id='3c55b2db4e894c99afac5e8e2cb5e4cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6e7cbad-5a09-459c-8082-cf836425bd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6e7cbad-5a09-459c-8082-cf836425bd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e15da0-8957-4355-9e85-e9c8d27f5b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e15da0-8957-4355-9e85-e9c8d27f5b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab7a898f-09d6-46e1-a388-32cd604274ec', 'volume_name': 'volume-ab7a898f-09d6-46e1-a388-32cd604274ec', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c06383d-f714-4934-89cb-51a86ffefd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c06383d-f714-4934-89cb-51a86ffefd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea08dae-261a-4f99-9dee-eb1388512bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:35 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Volume ab7a898f-09d6-46e1-a388-32cd604274ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab7a898f-09d6-46e1-a388-32cd604274ec', 'volume_size': 1} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-337591848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab7a898f-09d6-46e1-a388-32cd604274ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd2188f776741f7b49608d30acfb9ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:31:35Z,use_quota=True,user_id='3c55b2db4e894c99afac5e8e2cb5e4cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Creating volume ab7a898f-09d6-46e1-a388-32cd604274ec {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:31:35 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ab7a898f-09d6-46e1-a388-32cd604274ec 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:35 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ab7a898f-09d6-46e1-a388-32cd604274ec 1073741824 Nov 03 08:31:35 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Flow 'volume_create_manager' (093b4f17-f2d5-4037-830c-74db32ff8413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375cfd99-7550-4c87-acc9-6985001018f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375cfd99-7550-4c87-acc9-6985001018f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2036764994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c649132c-61e1-4de4-97b0-088c263e21ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd2188f776741f7b49608d30acfb9ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:31:35Z,use_quota=True,user_id='3c55b2db4e894c99afac5e8e2cb5e4cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6086437-d5c1-4c0a-bade-8807fd0a484d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6086437-d5c1-4c0a-bade-8807fd0a484d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb57fea9-a5ff-45b0-88a7-95836ecb5233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb57fea9-a5ff-45b0-88a7-95836ecb5233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c649132c-61e1-4de4-97b0-088c263e21ed', 'volume_name': 'volume-c649132c-61e1-4de4-97b0-088c263e21ed', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0970ad76-8b76-4435-8e95-9eff98cded8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0970ad76-8b76-4435-8e95-9eff98cded8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ef6340c-0295-470f-90c0-1095bc0abe77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:35 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Volume c649132c-61e1-4de4-97b0-088c263e21ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c649132c-61e1-4de4-97b0-088c263e21ed', 'volume_size': 1} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:35 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ab7a898f-09d6-46e1-a388-32cd604274ec 1073741824" returned: 0 in 0.649s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ab7a898f-09d6-46e1-a388-32cd604274ec {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:35 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ab7a898f-09d6-46e1-a388-32cd604274ec Nov 03 08:31:35 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Flow 'volume_create_manager' (cb2d7911-cccb-43c3-8255-0630e2fb9745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0029ad41-02c4-41cc-88a4-d568e3031262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0029ad41-02c4-41cc-88a4-d568e3031262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-280869230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74790d2e-959a-4ec3-a3c9-edef935a816c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd2188f776741f7b49608d30acfb9ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:31:36Z,use_quota=True,user_id='3c55b2db4e894c99afac5e8e2cb5e4cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91fef2a3-382c-470b-a0b5-748fe59cc344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91fef2a3-382c-470b-a0b5-748fe59cc344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d1a7a87-5a06-4591-aea0-27085295c744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d1a7a87-5a06-4591-aea0-27085295c744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74790d2e-959a-4ec3-a3c9-edef935a816c', 'volume_name': 'volume-74790d2e-959a-4ec3-a3c9-edef935a816c', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be160bb4-8cba-4b52-92ca-99249ed81926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be160bb4-8cba-4b52-92ca-99249ed81926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93417257-8fa7-4111-a739-ac45e46cac28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:36 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Volume 74790d2e-959a-4ec3-a3c9-edef935a816c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74790d2e-959a-4ec3-a3c9-edef935a816c', 'volume_size': 1} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:36 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ab7a898f-09d6-46e1-a388-32cd604274ec" returned: 0 in 0.334s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.615s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2036764994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c649132c-61e1-4de4-97b0-088c263e21ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd2188f776741f7b49608d30acfb9ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:31:35Z,use_quota=True,user_id='3c55b2db4e894c99afac5e8e2cb5e4cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Creating volume c649132c-61e1-4de4-97b0-088c263e21ed {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:31:36 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c649132c-61e1-4de4-97b0-088c263e21ed 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea08dae-261a-4f99-9dee-eb1388512bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab7a898f-09d6-46e1-a388-32cd604274ec', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:36 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c649132c-61e1-4de4-97b0-088c263e21ed 1073741824 Nov 03 08:31:36 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c40900c-6ee1-4ee0-8493-5cb1cf6a8251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:36 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Volume volume-ab7a898f-09d6-46e1-a388-32cd604274ec (ab7a898f-09d6-46e1-a388-32cd604274ec): created successfully Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c40900c-6ee1-4ee0-8493-5cb1cf6a8251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Flow 'volume_create_manager' (742fb21a-731c-4039-8bc6-c09ad9a95ab5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:31:36 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-7b9c814a-31be-4991-8a29-b457ade3e1a7 tempest-CreateVolumesFromImageTest-372587232 None] Created volume successfully. Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Flow 'volume_create_manager' (d075a8a2-7d64-4497-bd84-3d0b3b8e5717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c7d79d-406d-498a-8246-11510b6b4245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c7d79d-406d-498a-8246-11510b6b4245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-280517108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8facf8e7-33ff-4553-a62b-3d8cc6461ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd2188f776741f7b49608d30acfb9ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:31:36Z,use_quota=True,user_id='3c55b2db4e894c99afac5e8e2cb5e4cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3230a4-2459-4f3a-97ed-4864fb36566c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3230a4-2459-4f3a-97ed-4864fb36566c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64163cba-27f8-4795-a1bf-ae0c463421f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64163cba-27f8-4795-a1bf-ae0c463421f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8facf8e7-33ff-4553-a62b-3d8cc6461ff7', 'volume_name': 'volume-8facf8e7-33ff-4553-a62b-3d8cc6461ff7', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad21a74-86a3-4ec6-a711-03202326ed0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad21a74-86a3-4ec6-a711-03202326ed0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5729d48e-fd67-4fad-a7d0-68a7bf02e0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:36 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Volume 8facf8e7-33ff-4553-a62b-3d8cc6461ff7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8facf8e7-33ff-4553-a62b-3d8cc6461ff7', 'volume_size': 1} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:31:36 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Flow 'volume_create_manager' (f8d0b920-7151-497a-93db-4b42b8e1eb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0bc7e4d-2802-4a46-9809-ab01b220ce58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c649132c-61e1-4de4-97b0-088c263e21ed 1073741824" returned: 0 in 0.670s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0bc7e4d-2802-4a46-9809-ab01b220ce58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-407586621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6407716-b161-462f-83cb-38d75da1e7ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd2188f776741f7b49608d30acfb9ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:31:37Z,use_quota=True,user_id='3c55b2db4e894c99afac5e8e2cb5e4cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6db2bc0-6919-45ba-8b93-c28f734fd03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6db2bc0-6919-45ba-8b93-c28f734fd03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5439bf-4989-4e24-893f-4de0db1bdf95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5439bf-4989-4e24-893f-4de0db1bdf95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6407716-b161-462f-83cb-38d75da1e7ba', 'volume_name': 'volume-d6407716-b161-462f-83cb-38d75da1e7ba', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9738e72f-42af-415d-a62a-f8ca7914d641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9738e72f-42af-415d-a62a-f8ca7914d641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5f5eec4-407f-499e-9b80-3b505dc521ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:37 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Volume d6407716-b161-462f-83cb-38d75da1e7ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6407716-b161-462f-83cb-38d75da1e7ba', 'volume_size': 1} Nov 03 08:31:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c649132c-61e1-4de4-97b0-088c263e21ed {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:37 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c649132c-61e1-4de4-97b0-088c263e21ed Nov 03 08:31:37 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:37 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c649132c-61e1-4de4-97b0-088c263e21ed" returned: 0 in 0.247s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:31:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.154s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-280869230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74790d2e-959a-4ec3-a3c9-edef935a816c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd2188f776741f7b49608d30acfb9ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:31:36Z,use_quota=True,user_id='3c55b2db4e894c99afac5e8e2cb5e4cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:31:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Creating volume 74790d2e-959a-4ec3-a3c9-edef935a816c {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:31:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:31:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:31:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:31:37 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:31:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-74790d2e-959a-4ec3-a3c9-edef935a816c 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ef6340c-0295-470f-90c0-1095bc0abe77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c649132c-61e1-4de4-97b0-088c263e21ed', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:37 devstack sudo[104857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-74790d2e-959a-4ec3-a3c9-edef935a816c 1073741824 Nov 03 08:31:37 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbb6f077-e6bc-4009-8b2b-e71ce8dc0236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:37 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Volume volume-c649132c-61e1-4de4-97b0-088c263e21ed (c649132c-61e1-4de4-97b0-088c263e21ed): created successfully Nov 03 08:31:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbb6f077-e6bc-4009-8b2b-e71ce8dc0236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Flow 'volume_create_manager' (093b4f17-f2d5-4037-830c-74db32ff8413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:31:37 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-12a79aa2-3d55-49a3-b07d-4554dabb441c tempest-CreateVolumesFromImageTest-372587232 None] Created volume successfully. Nov 03 08:31:37 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-74790d2e-959a-4ec3-a3c9-edef935a816c 1073741824" returned: 0 in 0.435s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-74790d2e-959a-4ec3-a3c9-edef935a816c {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:37 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-74790d2e-959a-4ec3-a3c9-edef935a816c Nov 03 08:31:37 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:38 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-74790d2e-959a-4ec3-a3c9-edef935a816c" returned: 0 in 0.248s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.476s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-280517108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8facf8e7-33ff-4553-a62b-3d8cc6461ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd2188f776741f7b49608d30acfb9ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:31:36Z,use_quota=True,user_id='3c55b2db4e894c99afac5e8e2cb5e4cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Creating volume 8facf8e7-33ff-4553-a62b-3d8cc6461ff7 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:31:38 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8facf8e7-33ff-4553-a62b-3d8cc6461ff7 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93417257-8fa7-4111-a739-ac45e46cac28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74790d2e-959a-4ec3-a3c9-edef935a816c', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:38 devstack sudo[104865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8facf8e7-33ff-4553-a62b-3d8cc6461ff7 1073741824 Nov 03 08:31:38 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2a035cb-1e35-4e37-ab6f-8aad33bf5a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:38 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Volume volume-74790d2e-959a-4ec3-a3c9-edef935a816c (74790d2e-959a-4ec3-a3c9-edef935a816c): created successfully Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2a035cb-1e35-4e37-ab6f-8aad33bf5a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Flow 'volume_create_manager' (cb2d7911-cccb-43c3-8255-0630e2fb9745) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:31:38 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-745758d2-28ff-4bf2-857d-3ccd9f9819b4 tempest-CreateVolumesFromImageTest-372587232 None] Created volume successfully. Nov 03 08:31:38 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8facf8e7-33ff-4553-a62b-3d8cc6461ff7 1073741824" returned: 0 in 0.475s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8facf8e7-33ff-4553-a62b-3d8cc6461ff7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:38 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8facf8e7-33ff-4553-a62b-3d8cc6461ff7 Nov 03 08:31:38 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:38 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8facf8e7-33ff-4553-a62b-3d8cc6461ff7" returned: 0 in 0.243s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.795s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-407586621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6407716-b161-462f-83cb-38d75da1e7ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd2188f776741f7b49608d30acfb9ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:31:37Z,use_quota=True,user_id='3c55b2db4e894c99afac5e8e2cb5e4cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Creating volume d6407716-b161-462f-83cb-38d75da1e7ba {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:31:38 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d6407716-b161-462f-83cb-38d75da1e7ba 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5729d48e-fd67-4fad-a7d0-68a7bf02e0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8facf8e7-33ff-4553-a62b-3d8cc6461ff7', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:38 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d6407716-b161-462f-83cb-38d75da1e7ba 1073741824 Nov 03 08:31:38 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66bea539-4504-40ab-a339-0893d88f8351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:38 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Volume volume-8facf8e7-33ff-4553-a62b-3d8cc6461ff7 (8facf8e7-33ff-4553-a62b-3d8cc6461ff7): created successfully Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66bea539-4504-40ab-a339-0893d88f8351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Flow 'volume_create_manager' (d075a8a2-7d64-4497-bd84-3d0b3b8e5717) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:31:38 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-ff43b02f-3935-4ccb-b9df-cd59213cf2c7 tempest-CreateVolumesFromImageTest-372587232 None] Created volume successfully. Nov 03 08:31:39 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d6407716-b161-462f-83cb-38d75da1e7ba 1073741824" returned: 0 in 0.481s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d6407716-b161-462f-83cb-38d75da1e7ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:39 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d6407716-b161-462f-83cb-38d75da1e7ba Nov 03 08:31:39 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:39 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d6407716-b161-462f-83cb-38d75da1e7ba" returned: 0 in 0.279s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:39 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:31:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5f5eec4-407f-499e-9b80-3b505dc521ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6407716-b161-462f-83cb-38d75da1e7ba', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec823d88-2195-477e-8759-1dbebd6b4790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:39 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Volume volume-d6407716-b161-462f-83cb-38d75da1e7ba (d6407716-b161-462f-83cb-38d75da1e7ba): created successfully Nov 03 08:31:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec823d88-2195-477e-8759-1dbebd6b4790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Flow 'volume_create_manager' (f8d0b920-7151-497a-93db-4b42b8e1eb60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:31:39 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-f9aa29cf-dbc5-4d3d-a325-4ba1b8a3ef08 tempest-CreateVolumesFromImageTest-372587232 None] Created volume successfully. Nov 03 08:31:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-08cdc0f6-b419-47d3-9569-247c1bc0decc tempest-CreateVolumesFromImageTest-372587232 None] Acquiring lock "cinder-d6407716-b161-462f-83cb-38d75da1e7ba-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:31:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-08cdc0f6-b419-47d3-9569-247c1bc0decc tempest-CreateVolumesFromImageTest-372587232 None] Lock "cinder-d6407716-b161-462f-83cb-38d75da1e7ba-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:31:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-08cdc0f6-b419-47d3-9569-247c1bc0decc tempest-CreateVolumesFromImageTest-372587232 None] Acquiring lock "cinder-quobyte-d6407716-b161-462f-83cb-38d75da1e7ba" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:31:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-08cdc0f6-b419-47d3-9569-247c1bc0decc tempest-CreateVolumesFromImageTest-372587232 None] Lock "cinder-quobyte-d6407716-b161-462f-83cb-38d75da1e7ba" acquired by "delete_volume" :: waited 0.044s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:31:40 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[746df683-cffa-4a27-9961-eaedaaa77ea2]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:31:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-08cdc0f6-b419-47d3-9569-247c1bc0decc tempest-CreateVolumesFromImageTest-372587232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d6407716-b161-462f-83cb-38d75da1e7ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:40 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d6407716-b161-462f-83cb-38d75da1e7ba Nov 03 08:31:40 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:40 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-08cdc0f6-b419-47d3-9569-247c1bc0decc tempest-CreateVolumesFromImageTest-372587232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d6407716-b161-462f-83cb-38d75da1e7ba" returned: 0 in 0.387s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-08cdc0f6-b419-47d3-9569-247c1bc0decc tempest-CreateVolumesFromImageTest-372587232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d6407716-b161-462f-83cb-38d75da1e7ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:40 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d6407716-b161-462f-83cb-38d75da1e7ba Nov 03 08:31:40 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:41 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-08cdc0f6-b419-47d3-9569-247c1bc0decc tempest-CreateVolumesFromImageTest-372587232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d6407716-b161-462f-83cb-38d75da1e7ba" returned: 0 in 0.270s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:41 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-08cdc0f6-b419-47d3-9569-247c1bc0decc tempest-CreateVolumesFromImageTest-372587232 None] Lock "cinder-quobyte-d6407716-b161-462f-83cb-38d75da1e7ba" released by "delete_volume" :: held 0.715s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:31:41 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-08cdc0f6-b419-47d3-9569-247c1bc0decc tempest-CreateVolumesFromImageTest-372587232 None] Created reservations ['f02e3335-af6b-461d-90db-b15ab7a9632a', 'a7b745ac-37d9-4bdc-8d40-299b81dcceed', 'c1879259-d066-4452-9f69-3022c040acc3', '0aaeccdb-77b2-4e71-807a-002791697cf1'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:31:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-08cdc0f6-b419-47d3-9569-247c1bc0decc tempest-CreateVolumesFromImageTest-372587232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-08cdc0f6-b419-47d3-9569-247c1bc0decc tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-08cdc0f6-b419-47d3-9569-247c1bc0decc tempest-CreateVolumesFromImageTest-372587232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:31:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-08cdc0f6-b419-47d3-9569-247c1bc0decc tempest-CreateVolumesFromImageTest-372587232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:31:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-08cdc0f6-b419-47d3-9569-247c1bc0decc tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-08cdc0f6-b419-47d3-9569-247c1bc0decc tempest-CreateVolumesFromImageTest-372587232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:41 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:31:41 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:41 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f0afcb58-9ac4-4b90-9317-f707202d1df6 tempest-CreateVolumesFromImageTest-372587232 None] Acquiring lock "cinder-8facf8e7-33ff-4553-a62b-3d8cc6461ff7-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:31:41 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f0afcb58-9ac4-4b90-9317-f707202d1df6 tempest-CreateVolumesFromImageTest-372587232 None] Lock "cinder-8facf8e7-33ff-4553-a62b-3d8cc6461ff7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:31:41 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f0afcb58-9ac4-4b90-9317-f707202d1df6 tempest-CreateVolumesFromImageTest-372587232 None] Acquiring lock "cinder-quobyte-8facf8e7-33ff-4553-a62b-3d8cc6461ff7" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:31:41 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f0afcb58-9ac4-4b90-9317-f707202d1df6 tempest-CreateVolumesFromImageTest-372587232 None] Lock "cinder-quobyte-8facf8e7-33ff-4553-a62b-3d8cc6461ff7" acquired by "delete_volume" :: waited 0.020s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:31:41 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-08cdc0f6-b419-47d3-9569-247c1bc0decc tempest-CreateVolumesFromImageTest-372587232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.271s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:41 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-08cdc0f6-b419-47d3-9569-247c1bc0decc tempest-CreateVolumesFromImageTest-372587232 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:31:41 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-08cdc0f6-b419-47d3-9569-247c1bc0decc tempest-CreateVolumesFromImageTest-372587232 None] Deleted volume successfully. Nov 03 08:31:41 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0aee59-c6d9-49ba-a447-f14b1646ca1f]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:31:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f0afcb58-9ac4-4b90-9317-f707202d1df6 tempest-CreateVolumesFromImageTest-372587232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8facf8e7-33ff-4553-a62b-3d8cc6461ff7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:41 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-08cdc0f6-b419-47d3-9569-247c1bc0decc tempest-CreateVolumesFromImageTest-372587232 None] Lock "cinder-d6407716-b161-462f-83cb-38d75da1e7ba-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:31:41 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8facf8e7-33ff-4553-a62b-3d8cc6461ff7 Nov 03 08:31:41 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:42 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f0afcb58-9ac4-4b90-9317-f707202d1df6 tempest-CreateVolumesFromImageTest-372587232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8facf8e7-33ff-4553-a62b-3d8cc6461ff7" returned: 0 in 0.376s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f0afcb58-9ac4-4b90-9317-f707202d1df6 tempest-CreateVolumesFromImageTest-372587232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8facf8e7-33ff-4553-a62b-3d8cc6461ff7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:42 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8facf8e7-33ff-4553-a62b-3d8cc6461ff7 Nov 03 08:31:42 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:42 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f0afcb58-9ac4-4b90-9317-f707202d1df6 tempest-CreateVolumesFromImageTest-372587232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8facf8e7-33ff-4553-a62b-3d8cc6461ff7" returned: 0 in 0.276s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f0afcb58-9ac4-4b90-9317-f707202d1df6 tempest-CreateVolumesFromImageTest-372587232 None] Lock "cinder-quobyte-8facf8e7-33ff-4553-a62b-3d8cc6461ff7" released by "delete_volume" :: held 0.704s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:31:42 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-f0afcb58-9ac4-4b90-9317-f707202d1df6 tempest-CreateVolumesFromImageTest-372587232 None] Created reservations ['021b9c0e-51fe-425f-88ec-b19dd668d379', 'c863a0e2-0ec3-4565-a78f-78c951607fe1', '453099fe-e89e-472e-948f-d23a3a673ca5', 'a32acaf1-6131-4ed5-b073-85d467267524'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:31:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f0afcb58-9ac4-4b90-9317-f707202d1df6 tempest-CreateVolumesFromImageTest-372587232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f0afcb58-9ac4-4b90-9317-f707202d1df6 tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:42 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f0afcb58-9ac4-4b90-9317-f707202d1df6 tempest-CreateVolumesFromImageTest-372587232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:31:42 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f0afcb58-9ac4-4b90-9317-f707202d1df6 tempest-CreateVolumesFromImageTest-372587232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:31:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f0afcb58-9ac4-4b90-9317-f707202d1df6 tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f0afcb58-9ac4-4b90-9317-f707202d1df6 tempest-CreateVolumesFromImageTest-372587232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:42 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:31:42 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:42 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f0afcb58-9ac4-4b90-9317-f707202d1df6 tempest-CreateVolumesFromImageTest-372587232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.253s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:42 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-f0afcb58-9ac4-4b90-9317-f707202d1df6 tempest-CreateVolumesFromImageTest-372587232 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:31:42 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-f0afcb58-9ac4-4b90-9317-f707202d1df6 tempest-CreateVolumesFromImageTest-372587232 None] Deleted volume successfully. Nov 03 08:31:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-70a6550d-b1a8-404f-bea4-dd8f0f6258c9 tempest-CreateVolumesFromImageTest-372587232 None] Acquiring lock "cinder-74790d2e-959a-4ec3-a3c9-edef935a816c-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:31:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f0afcb58-9ac4-4b90-9317-f707202d1df6 tempest-CreateVolumesFromImageTest-372587232 None] Lock "cinder-8facf8e7-33ff-4553-a62b-3d8cc6461ff7-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:31:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-70a6550d-b1a8-404f-bea4-dd8f0f6258c9 tempest-CreateVolumesFromImageTest-372587232 None] Lock "cinder-74790d2e-959a-4ec3-a3c9-edef935a816c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:31:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-70a6550d-b1a8-404f-bea4-dd8f0f6258c9 tempest-CreateVolumesFromImageTest-372587232 None] Acquiring lock "cinder-quobyte-74790d2e-959a-4ec3-a3c9-edef935a816c" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:31:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-70a6550d-b1a8-404f-bea4-dd8f0f6258c9 tempest-CreateVolumesFromImageTest-372587232 None] Lock "cinder-quobyte-74790d2e-959a-4ec3-a3c9-edef935a816c" acquired by "delete_volume" :: waited 0.018s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:31:42 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[421c9b34-c01c-493a-aed9-5ba66a7a5141]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:31:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-70a6550d-b1a8-404f-bea4-dd8f0f6258c9 tempest-CreateVolumesFromImageTest-372587232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-74790d2e-959a-4ec3-a3c9-edef935a816c {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:42 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-74790d2e-959a-4ec3-a3c9-edef935a816c Nov 03 08:31:42 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:43 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-70a6550d-b1a8-404f-bea4-dd8f0f6258c9 tempest-CreateVolumesFromImageTest-372587232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-74790d2e-959a-4ec3-a3c9-edef935a816c" returned: 0 in 0.396s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-70a6550d-b1a8-404f-bea4-dd8f0f6258c9 tempest-CreateVolumesFromImageTest-372587232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-74790d2e-959a-4ec3-a3c9-edef935a816c {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:43 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-74790d2e-959a-4ec3-a3c9-edef935a816c Nov 03 08:31:43 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:43 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-70a6550d-b1a8-404f-bea4-dd8f0f6258c9 tempest-CreateVolumesFromImageTest-372587232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-74790d2e-959a-4ec3-a3c9-edef935a816c" returned: 0 in 0.256s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-70a6550d-b1a8-404f-bea4-dd8f0f6258c9 tempest-CreateVolumesFromImageTest-372587232 None] Lock "cinder-quobyte-74790d2e-959a-4ec3-a3c9-edef935a816c" released by "delete_volume" :: held 0.710s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:31:43 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-70a6550d-b1a8-404f-bea4-dd8f0f6258c9 tempest-CreateVolumesFromImageTest-372587232 None] Created reservations ['472d4063-daa1-43bd-9890-6a6a7a126850', 'd43932c6-07de-4939-b88f-33b16de3739c', '15741835-e1e0-4b50-b7a7-2f36a1456188', '0a87995a-886a-4da2-aa98-7e82790c9d38'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:31:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-70a6550d-b1a8-404f-bea4-dd8f0f6258c9 tempest-CreateVolumesFromImageTest-372587232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-70a6550d-b1a8-404f-bea4-dd8f0f6258c9 tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:43 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-70a6550d-b1a8-404f-bea4-dd8f0f6258c9 tempest-CreateVolumesFromImageTest-372587232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:31:43 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-70a6550d-b1a8-404f-bea4-dd8f0f6258c9 tempest-CreateVolumesFromImageTest-372587232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:31:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-70a6550d-b1a8-404f-bea4-dd8f0f6258c9 tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-70a6550d-b1a8-404f-bea4-dd8f0f6258c9 tempest-CreateVolumesFromImageTest-372587232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:43 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:31:43 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:43 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-70a6550d-b1a8-404f-bea4-dd8f0f6258c9 tempest-CreateVolumesFromImageTest-372587232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.267s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:43 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-70a6550d-b1a8-404f-bea4-dd8f0f6258c9 tempest-CreateVolumesFromImageTest-372587232 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:31:43 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-70a6550d-b1a8-404f-bea4-dd8f0f6258c9 tempest-CreateVolumesFromImageTest-372587232 None] Deleted volume successfully. Nov 03 08:31:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-70a6550d-b1a8-404f-bea4-dd8f0f6258c9 tempest-CreateVolumesFromImageTest-372587232 None] Lock "cinder-74790d2e-959a-4ec3-a3c9-edef935a816c-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:31:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-95104d83-faea-4017-a442-830f76843f56 tempest-CreateVolumesFromImageTest-372587232 None] Acquiring lock "cinder-c649132c-61e1-4de4-97b0-088c263e21ed-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:31:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-95104d83-faea-4017-a442-830f76843f56 tempest-CreateVolumesFromImageTest-372587232 None] Lock "cinder-c649132c-61e1-4de4-97b0-088c263e21ed-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:31:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-95104d83-faea-4017-a442-830f76843f56 tempest-CreateVolumesFromImageTest-372587232 None] Acquiring lock "cinder-quobyte-c649132c-61e1-4de4-97b0-088c263e21ed" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:31:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-95104d83-faea-4017-a442-830f76843f56 tempest-CreateVolumesFromImageTest-372587232 None] Lock "cinder-quobyte-c649132c-61e1-4de4-97b0-088c263e21ed" acquired by "delete_volume" :: waited 0.017s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5a433c-b741-4f39-90cb-8549c5854082]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-95104d83-faea-4017-a442-830f76843f56 tempest-CreateVolumesFromImageTest-372587232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c649132c-61e1-4de4-97b0-088c263e21ed {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:44 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c649132c-61e1-4de4-97b0-088c263e21ed Nov 03 08:31:44 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:44 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-95104d83-faea-4017-a442-830f76843f56 tempest-CreateVolumesFromImageTest-372587232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c649132c-61e1-4de4-97b0-088c263e21ed" returned: 0 in 0.368s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-95104d83-faea-4017-a442-830f76843f56 tempest-CreateVolumesFromImageTest-372587232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c649132c-61e1-4de4-97b0-088c263e21ed {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:44 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c649132c-61e1-4de4-97b0-088c263e21ed Nov 03 08:31:44 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:44 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-95104d83-faea-4017-a442-830f76843f56 tempest-CreateVolumesFromImageTest-372587232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-c649132c-61e1-4de4-97b0-088c263e21ed" returned: 0 in 0.273s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Flow 'volume_create_manager' (af1aa091-a03d-4147-8d60-28d10deefe91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ddc7998-c475-4b4c-b4ec-8da3c457cd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-95104d83-faea-4017-a442-830f76843f56 tempest-CreateVolumesFromImageTest-372587232 None] Lock "cinder-quobyte-c649132c-61e1-4de4-97b0-088c263e21ed" released by "delete_volume" :: held 0.715s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ddc7998-c475-4b4c-b4ec-8da3c457cd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc9b45e-6a32-4460-846c-3391da515c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b20d846faded4f35a061cded6d45dd3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:31:45Z,use_quota=True,user_id='ad015a40aafc454c948e6840f897a454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96345dff-70de-4395-aa1f-ea6e14e20aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96345dff-70de-4395-aa1f-ea6e14e20aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480d868c-ce05-482e-9932-8fecc2719892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480d868c-ce05-482e-9932-8fecc2719892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbc9b45e-6a32-4460-846c-3391da515c93', 'volume_name': 'volume-fbc9b45e-6a32-4460-846c-3391da515c93', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (220dcfa4-0859-40a8-bb5f-22f4bb7581c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (220dcfa4-0859-40a8-bb5f-22f4bb7581c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa6310e-74b9-493d-a78d-585867b82c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:44 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Volume fbc9b45e-6a32-4460-846c-3391da515c93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbc9b45e-6a32-4460-846c-3391da515c93', 'volume_size': 1} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc9b45e-6a32-4460-846c-3391da515c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b20d846faded4f35a061cded6d45dd3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:31:45Z,use_quota=True,user_id='ad015a40aafc454c948e6840f897a454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Creating volume fbc9b45e-6a32-4460-846c-3391da515c93 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:31:44 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-fbc9b45e-6a32-4460-846c-3391da515c93 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:44 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-fbc9b45e-6a32-4460-846c-3391da515c93 1073741824 Nov 03 08:31:44 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-95104d83-faea-4017-a442-830f76843f56 tempest-CreateVolumesFromImageTest-372587232 None] Created reservations ['1bc83940-7c5b-4afd-b481-bf6a6af3c6a3', '26f9ef38-4925-4e65-a94c-52b198c51828', '6fe027d0-3b66-4dc6-965b-b871ca03bd82', '234dbad9-ed8e-4d96-a4b1-a9fe69e714a4'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-95104d83-faea-4017-a442-830f76843f56 tempest-CreateVolumesFromImageTest-372587232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-95104d83-faea-4017-a442-830f76843f56 tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-95104d83-faea-4017-a442-830f76843f56 tempest-CreateVolumesFromImageTest-372587232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-95104d83-faea-4017-a442-830f76843f56 tempest-CreateVolumesFromImageTest-372587232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-95104d83-faea-4017-a442-830f76843f56 tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-95104d83-faea-4017-a442-830f76843f56 tempest-CreateVolumesFromImageTest-372587232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:44 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:31:44 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-def294d9-9148-464a-b350-5e0b2a3a2163 tempest-CreateVolumesFromImageTest-372587232 None] Acquiring lock "cinder-ab7a898f-09d6-46e1-a388-32cd604274ec-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-def294d9-9148-464a-b350-5e0b2a3a2163 tempest-CreateVolumesFromImageTest-372587232 None] Lock "cinder-ab7a898f-09d6-46e1-a388-32cd604274ec-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:31:45 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-95104d83-faea-4017-a442-830f76843f56 tempest-CreateVolumesFromImageTest-372587232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.290s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-95104d83-faea-4017-a442-830f76843f56 tempest-CreateVolumesFromImageTest-372587232 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-def294d9-9148-464a-b350-5e0b2a3a2163 tempest-CreateVolumesFromImageTest-372587232 None] Acquiring lock "cinder-quobyte-ab7a898f-09d6-46e1-a388-32cd604274ec" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:31:45 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-95104d83-faea-4017-a442-830f76843f56 tempest-CreateVolumesFromImageTest-372587232 None] Deleted volume successfully. Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-def294d9-9148-464a-b350-5e0b2a3a2163 tempest-CreateVolumesFromImageTest-372587232 None] Lock "cinder-quobyte-ab7a898f-09d6-46e1-a388-32cd604274ec" acquired by "delete_volume" :: waited 0.021s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-95104d83-faea-4017-a442-830f76843f56 tempest-CreateVolumesFromImageTest-372587232 None] Lock "cinder-c649132c-61e1-4de4-97b0-088c263e21ed-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bad5618-99ed-4d85-8094-08c3b56c9e25]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-def294d9-9148-464a-b350-5e0b2a3a2163 tempest-CreateVolumesFromImageTest-372587232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ab7a898f-09d6-46e1-a388-32cd604274ec {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:45 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-fbc9b45e-6a32-4460-846c-3391da515c93 1073741824" returned: 0 in 0.502s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-fbc9b45e-6a32-4460-846c-3391da515c93 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:45 devstack sudo[104938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-fbc9b45e-6a32-4460-846c-3391da515c93 Nov 03 08:31:45 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:45 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ab7a898f-09d6-46e1-a388-32cd604274ec Nov 03 08:31:45 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:45 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-fbc9b45e-6a32-4460-846c-3391da515c93" returned: 0 in 0.245s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa6310e-74b9-493d-a78d-585867b82c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbc9b45e-6a32-4460-846c-3391da515c93', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68dfaf89-b77e-40ce-ad62-ecdbb306309b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:45 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Volume volume-fbc9b45e-6a32-4460-846c-3391da515c93 (fbc9b45e-6a32-4460-846c-3391da515c93): created successfully Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68dfaf89-b77e-40ce-ad62-ecdbb306309b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Flow 'volume_create_manager' (af1aa091-a03d-4147-8d60-28d10deefe91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:31:45 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-def294d9-9148-464a-b350-5e0b2a3a2163 tempest-CreateVolumesFromImageTest-372587232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ab7a898f-09d6-46e1-a388-32cd604274ec" returned: 0 in 0.378s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-def294d9-9148-464a-b350-5e0b2a3a2163 tempest-CreateVolumesFromImageTest-372587232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ab7a898f-09d6-46e1-a388-32cd604274ec {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:45 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-a050ecb4-0ddc-4527-ab7a-54e1bca28b59 tempest-CinderUnicodeTest-1549750699 None] Created volume successfully. Nov 03 08:31:45 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ab7a898f-09d6-46e1-a388-32cd604274ec Nov 03 08:31:45 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:45 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-def294d9-9148-464a-b350-5e0b2a3a2163 tempest-CreateVolumesFromImageTest-372587232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ab7a898f-09d6-46e1-a388-32cd604274ec" returned: 0 in 0.250s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-def294d9-9148-464a-b350-5e0b2a3a2163 tempest-CreateVolumesFromImageTest-372587232 None] Lock "cinder-quobyte-ab7a898f-09d6-46e1-a388-32cd604274ec" released by "delete_volume" :: held 0.671s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-def294d9-9148-464a-b350-5e0b2a3a2163 tempest-CreateVolumesFromImageTest-372587232 None] Created reservations ['537a1cf8-5663-4609-95a3-f939bfd054ec', '2de8d20d-b5be-4b52-806b-4ed66425993f', 'f71c9d43-a240-4684-bd30-185cd1a1b0da', 'df300665-14e3-4657-8820-b3e2895304d0'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-def294d9-9148-464a-b350-5e0b2a3a2163 tempest-CreateVolumesFromImageTest-372587232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-def294d9-9148-464a-b350-5e0b2a3a2163 tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-def294d9-9148-464a-b350-5e0b2a3a2163 tempest-CreateVolumesFromImageTest-372587232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-def294d9-9148-464a-b350-5e0b2a3a2163 tempest-CreateVolumesFromImageTest-372587232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-def294d9-9148-464a-b350-5e0b2a3a2163 tempest-CreateVolumesFromImageTest-372587232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-def294d9-9148-464a-b350-5e0b2a3a2163 tempest-CreateVolumesFromImageTest-372587232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:46 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:31:46 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:46 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-def294d9-9148-464a-b350-5e0b2a3a2163 tempest-CreateVolumesFromImageTest-372587232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.251s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:46 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-def294d9-9148-464a-b350-5e0b2a3a2163 tempest-CreateVolumesFromImageTest-372587232 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:31:46 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-def294d9-9148-464a-b350-5e0b2a3a2163 tempest-CreateVolumesFromImageTest-372587232 None] Deleted volume successfully. Nov 03 08:31:46 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-def294d9-9148-464a-b350-5e0b2a3a2163 tempest-CreateVolumesFromImageTest-372587232 None] Lock "cinder-ab7a898f-09d6-46e1-a388-32cd604274ec-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:31:47 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:31:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Flow 'volume_create_manager' (762ccb03-88dd-45fd-afdd-7696e5ad323d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:31:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3b6d57f-db50-4d08-a257-a4f67dbb2db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3b6d57f-db50-4d08-a257-a4f67dbb2db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:31:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-460758045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef0e2bce-4e57-446f-b007-a77c89afceea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b20d846faded4f35a061cded6d45dd3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:31:47Z,use_quota=True,user_id='ad015a40aafc454c948e6840f897a454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86073db8-03bd-4fe2-8dbf-37250f1ad26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86073db8-03bd-4fe2-8dbf-37250f1ad26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58334d01-a1dc-4dbb-b666-6f5a18fe7251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58334d01-a1dc-4dbb-b666-6f5a18fe7251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef0e2bce-4e57-446f-b007-a77c89afceea', 'volume_name': 'volume-ef0e2bce-4e57-446f-b007-a77c89afceea', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e745f0-6486-4cea-b197-fb716f04b9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e745f0-6486-4cea-b197-fb716f04b9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39d1be8-1888-470f-ab78-4c70f7a34171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:47 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Volume ef0e2bce-4e57-446f-b007-a77c89afceea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef0e2bce-4e57-446f-b007-a77c89afceea', 'volume_size': 1} Nov 03 08:31:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:47 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:31:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-460758045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef0e2bce-4e57-446f-b007-a77c89afceea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b20d846faded4f35a061cded6d45dd3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:31:47Z,use_quota=True,user_id='ad015a40aafc454c948e6840f897a454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:31:47 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Creating volume ef0e2bce-4e57-446f-b007-a77c89afceea {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:31:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:47 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:31:47 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:31:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:47 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:31:47 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:31:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:47 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea 1073741824 Nov 03 08:31:47 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:47 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea 1073741824" returned: 0 in 0.450s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:47 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea Nov 03 08:31:47 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:48 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea" returned: 0 in 0.255s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:31:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39d1be8-1888-470f-ab78-4c70f7a34171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef0e2bce-4e57-446f-b007-a77c89afceea', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (618c2317-e421-440d-a09f-b1fb3bf556ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:48 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Volume volume-ef0e2bce-4e57-446f-b007-a77c89afceea (ef0e2bce-4e57-446f-b007-a77c89afceea): created successfully Nov 03 08:31:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (618c2317-e421-440d-a09f-b1fb3bf556ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Flow 'volume_create_manager' (762ccb03-88dd-45fd-afdd-7696e5ad323d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:31:48 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-223db1d5-36c3-4772-8216-6b9ec28e7a2d tempest-CinderUnicodeTest-1549750699 None] Created volume successfully. Nov 03 08:31:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1c6f4ad9-8d45-4826-b1f1-3787e9c63c32 tempest-CinderUnicodeTest-1549750699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1c6f4ad9-8d45-4826-b1f1-3787e9c63c32 tempest-CinderUnicodeTest-1549750699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:49 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-1c6f4ad9-8d45-4826-b1f1-3787e9c63c32 tempest-CinderUnicodeTest-1549750699 None] Creating offline snapshot 825015c1-6e68-45ca-a10a-a6ad5d9b8378 of volume ef0e2bce-4e57-446f-b007-a77c89afceea {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:31:49 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac50a2f9-cc94-4004-87d6-7f296ba14384]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:31:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1c6f4ad9-8d45-4826-b1f1-3787e9c63c32 tempest-CinderUnicodeTest-1549750699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:49 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea Nov 03 08:31:49 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:50 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1c6f4ad9-8d45-4826-b1f1-3787e9c63c32 tempest-CinderUnicodeTest-1549750699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea" returned: 0 in 0.361s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1c6f4ad9-8d45-4826-b1f1-3787e9c63c32 tempest-CinderUnicodeTest-1549750699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea.825015c1-6e68-45ca-a10a-a6ad5d9b8378 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:50 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea.825015c1-6e68-45ca-a10a-a6ad5d9b8378 1G Nov 03 08:31:50 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:50 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1c6f4ad9-8d45-4826-b1f1-3787e9c63c32 tempest-CinderUnicodeTest-1549750699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea.825015c1-6e68-45ca-a10a-a6ad5d9b8378 1G" returned: 0 in 0.390s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1c6f4ad9-8d45-4826-b1f1-3787e9c63c32 tempest-CinderUnicodeTest-1549750699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef0e2bce-4e57-446f-b007-a77c89afceea -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea.825015c1-6e68-45ca-a10a-a6ad5d9b8378 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:50 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef0e2bce-4e57-446f-b007-a77c89afceea -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea.825015c1-6e68-45ca-a10a-a6ad5d9b8378 Nov 03 08:31:50 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:50 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1c6f4ad9-8d45-4826-b1f1-3787e9c63c32 tempest-CinderUnicodeTest-1549750699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef0e2bce-4e57-446f-b007-a77c89afceea -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea.825015c1-6e68-45ca-a10a-a6ad5d9b8378" returned: 0 in 0.308s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:50 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-1c6f4ad9-8d45-4826-b1f1-3787e9c63c32 tempest-CinderUnicodeTest-1549750699 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea.825015c1-6e68-45ca-a10a-a6ad5d9b8378 is being set with open permissions: ugo+rw Nov 03 08:31:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1c6f4ad9-8d45-4826-b1f1-3787e9c63c32 tempest-CinderUnicodeTest-1549750699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea.825015c1-6e68-45ca-a10a-a6ad5d9b8378 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:50 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea.825015c1-6e68-45ca-a10a-a6ad5d9b8378 Nov 03 08:31:50 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:50 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1c6f4ad9-8d45-4826-b1f1-3787e9c63c32 tempest-CinderUnicodeTest-1549750699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea.825015c1-6e68-45ca-a10a-a6ad5d9b8378" returned: 0 in 0.251s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1c6f4ad9-8d45-4826-b1f1-3787e9c63c32 tempest-CinderUnicodeTest-1549750699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:51 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea.info Nov 03 08:31:51 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Flow 'volume_create_manager' (32122063-8d19-4650-8cd8-bf7ea50c8c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83418b5d-c4b1-4682-9f03-94a515c82a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:51 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83418b5d-c4b1-4682-9f03-94a515c82a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e9ad80-6c79-4072-adb4-c92340b4ebd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8ae2fb9cfc9445d832461212feca63d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:31:51Z,use_quota=True,user_id='4ab538111a8c436ba9da32f1beaba764',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b165f7-8b8a-466f-949c-4648515cea7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b165f7-8b8a-466f-949c-4648515cea7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc94124d-eb4b-4d75-b97d-0cba913601cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG cinder.image.glance [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Creating Keystone auth plugin from conf {{(pid=86801) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1c6f4ad9-8d45-4826-b1f1-3787e9c63c32 tempest-CinderUnicodeTest-1549750699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea.info" returned: 0 in 0.330s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:51 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-1c6f4ad9-8d45-4826-b1f1-3787e9c63c32 tempest-CinderUnicodeTest-1549750699 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea.info is being set with open permissions: ugo+rw Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1c6f4ad9-8d45-4826-b1f1-3787e9c63c32 tempest-CinderUnicodeTest-1549750699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:51 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea.info Nov 03 08:31:51 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc94124d-eb4b-4d75-b97d-0cba913601cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f0e9ad80-6c79-4072-adb4-c92340b4ebd3', 'volume_name': 'volume-f0e9ad80-6c79-4072-adb4-c92340b4ebd3', 'volume_size': 1, 'image_id': 'f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2e1c1ab220a87589e066e488469096f6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b8ae2fb9cfc9445d832461212feca63d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd86d1aa8a58224c7f678c6006580b400a0eeeb2e38283297ae8f0a0c87c2471a9a59fe8984d86da478465ff6f2bccbdbcdb2d7496eee6cfd1d90bff9490a099c', 'id': 'f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1', 'created_at': datetime.datetime(2026, 11, 3, 7, 31, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 31, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1/file', 'properties': {}}, 'image_service': }' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb284876-2607-405f-90ce-094201407ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb284876-2607-405f-90ce-094201407ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:51 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae9207a9-538c-4c66-9b85-08f1df33ffc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:51 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Volume f0e9ad80-6c79-4072-adb4-c92340b4ebd3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f0e9ad80-6c79-4072-adb4-c92340b4ebd3', 'volume_size': 1, 'image_id': 'f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2e1c1ab220a87589e066e488469096f6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b8ae2fb9cfc9445d832461212feca63d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd86d1aa8a58224c7f678c6006580b400a0eeeb2e38283297ae8f0a0c87c2471a9a59fe8984d86da478465ff6f2bccbdbcdb2d7496eee6cfd1d90bff9490a099c', 'id': 'f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1', 'created_at': datetime.datetime(2026, 11, 3, 7, 31, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 31, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1/file', 'properties': {}}, 'image_service': } Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Trying to clone f0e9ad80-6c79-4072-adb4-c92340b4ebd3 from image f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1', 'metadata': {}}]). {{(pid=86801) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1c6f4ad9-8d45-4826-b1f1-3787e9c63c32 tempest-CinderUnicodeTest-1549750699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea.info" returned: 0 in 0.260s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1c6f4ad9-8d45-4826-b1f1-3787e9c63c32 tempest-CinderUnicodeTest-1549750699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.990s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:51 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-1c6f4ad9-8d45-4826-b1f1-3787e9c63c32 tempest-CinderUnicodeTest-1549750699 None] Create snapshot completed successfully Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_zijpj9s_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 08:31:51 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Image download 0.00 MB at 0.00 MB/s Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7baddc-ec6f-462f-b2ed-2689ffe254b9]: (4, 'raw') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_zijpj9s_devstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8337a009-4576-4bff-8bf2-3d2b415d1c8f tempest-CinderUnicodeTest-1549750699 None] Acquiring lock "cinder-825015c1-6e68-45ca-a10a-a6ad5d9b8378-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8337a009-4576-4bff-8bf2-3d2b415d1c8f tempest-CinderUnicodeTest-1549750699 None] Lock "cinder-825015c1-6e68-45ca-a10a-a6ad5d9b8378-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8337a009-4576-4bff-8bf2-3d2b415d1c8f tempest-CinderUnicodeTest-1549750699 None] Acquiring lock "cinder-quobyte-ef0e2bce-4e57-446f-b007-a77c89afceea" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8337a009-4576-4bff-8bf2-3d2b415d1c8f tempest-CinderUnicodeTest-1549750699 None] Lock "cinder-quobyte-ef0e2bce-4e57-446f-b007-a77c89afceea" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8337a009-4576-4bff-8bf2-3d2b415d1c8f tempest-CinderUnicodeTest-1549750699 None] Acquiring lock "cinder-quobyte-825015c1-6e68-45ca-a10a-a6ad5d9b8378" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8337a009-4576-4bff-8bf2-3d2b415d1c8f tempest-CinderUnicodeTest-1549750699 None] Lock "cinder-quobyte-825015c1-6e68-45ca-a10a-a6ad5d9b8378" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-8337a009-4576-4bff-8bf2-3d2b415d1c8f tempest-CinderUnicodeTest-1549750699 None] Deleting offline snapshot 825015c1-6e68-45ca-a10a-a6ad5d9b8378 of volume ef0e2bce-4e57-446f-b007-a77c89afceea {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-8337a009-4576-4bff-8bf2-3d2b415d1c8f tempest-CinderUnicodeTest-1549750699 None] snapshot_file for this snap is: volume-ef0e2bce-4e57-446f-b007-a77c89afceea.825015c1-6e68-45ca-a10a-a6ad5d9b8378 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[002f0284-bad0-4ed6-8888-ffe7729b7461]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:31:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8337a009-4576-4bff-8bf2-3d2b415d1c8f tempest-CinderUnicodeTest-1549750699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea.825015c1-6e68-45ca-a10a-a6ad5d9b8378 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:51 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_zijpj9s_devstack@QuobyteHD Nov 03 08:31:51 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:51 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea.825015c1-6e68-45ca-a10a-a6ad5d9b8378 Nov 03 08:31:51 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:52 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_zijpj9s_devstack@QuobyteHD" returned: 0 in 0.347s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_zijpj9s_devstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:52 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_zijpj9s_devstack@QuobyteHD Nov 03 08:31:52 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:52 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8337a009-4576-4bff-8bf2-3d2b415d1c8f tempest-CinderUnicodeTest-1549750699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea.825015c1-6e68-45ca-a10a-a6ad5d9b8378" returned: 0 in 0.367s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:52 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-8337a009-4576-4bff-8bf2-3d2b415d1c8f tempest-CinderUnicodeTest-1549750699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef0e2bce-4e57-446f-b007-a77c89afceea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:31:52 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[c825fa54-d3ac-43e6-82ce-3c8a0fa3c538]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:31:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8337a009-4576-4bff-8bf2-3d2b415d1c8f tempest-CinderUnicodeTest-1549750699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:52 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea Nov 03 08:31:52 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:52 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_zijpj9s_devstack@QuobyteHD" returned: 1 in 0.324s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_zijpj9s_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 08:31:52 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Temporary image f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1 is fetched for user 4ab538111a8c436ba9da32f1beaba764. {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 08:31:52 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[8605dcc9-8fb4-4606-984f-e4aacdd2a97a]: (4, 'raw') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:31:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_zijpj9s_devstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:52 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_zijpj9s_devstack@QuobyteHD Nov 03 08:31:52 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:52 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8337a009-4576-4bff-8bf2-3d2b415d1c8f tempest-CinderUnicodeTest-1549750699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea" returned: 0 in 0.370s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8337a009-4576-4bff-8bf2-3d2b415d1c8f tempest-CinderUnicodeTest-1549750699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea.825015c1-6e68-45ca-a10a-a6ad5d9b8378 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:52 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea.825015c1-6e68-45ca-a10a-a6ad5d9b8378 Nov 03 08:31:52 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:52 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_zijpj9s_devstack@QuobyteHD" returned: 0 in 0.331s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_zijpj9s_devstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:52 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_zijpj9s_devstack@QuobyteHD Nov 03 08:31:52 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:52 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8337a009-4576-4bff-8bf2-3d2b415d1c8f tempest-CinderUnicodeTest-1549750699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea.825015c1-6e68-45ca-a10a-a6ad5d9b8378" returned: 0 in 0.337s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8337a009-4576-4bff-8bf2-3d2b415d1c8f tempest-CinderUnicodeTest-1549750699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea.825015c1-6e68-45ca-a10a-a6ad5d9b8378 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:52 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea.825015c1-6e68-45ca-a10a-a6ad5d9b8378 Nov 03 08:31:53 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:53 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_zijpj9s_devstack@QuobyteHD" returned: 1 in 0.331s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_zijpj9s_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 08:31:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e9ad80-6c79-4072-adb4-c92340b4ebd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8ae2fb9cfc9445d832461212feca63d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:31:51Z,use_quota=True,user_id='4ab538111a8c436ba9da32f1beaba764',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:31:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Creating volume f0e9ad80-6c79-4072-adb4-c92340b4ebd3 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:31:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:31:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:31:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:31:53 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:31:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0e9ad80-6c79-4072-adb4-c92340b4ebd3 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:53 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0e9ad80-6c79-4072-adb4-c92340b4ebd3 1073741824 Nov 03 08:31:53 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:53 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8337a009-4576-4bff-8bf2-3d2b415d1c8f tempest-CinderUnicodeTest-1549750699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea.825015c1-6e68-45ca-a10a-a6ad5d9b8378" returned: 0 in 0.252s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:53 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8337a009-4576-4bff-8bf2-3d2b415d1c8f tempest-CinderUnicodeTest-1549750699 None] Lock "cinder-quobyte-825015c1-6e68-45ca-a10a-a6ad5d9b8378" released by "_delete_snapshot" :: held 1.454s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:31:53 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8337a009-4576-4bff-8bf2-3d2b415d1c8f tempest-CinderUnicodeTest-1549750699 None] Lock "cinder-quobyte-ef0e2bce-4e57-446f-b007-a77c89afceea" released by "delete_snapshot" :: held 1.476s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:31:53 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-8337a009-4576-4bff-8bf2-3d2b415d1c8f tempest-CinderUnicodeTest-1549750699 None] Created reservations ['054deb54-30f9-49bd-9b18-5abdddc3d3ac', '2bb7f883-86e7-414f-a6eb-40a83965506e', '81925405-612c-4934-aae1-956788c17a48', '170a2c92-aea0-4f82-b72d-5aaa2cd6bb49'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:31:53 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-8337a009-4576-4bff-8bf2-3d2b415d1c8f tempest-CinderUnicodeTest-1549750699 None] Delete snapshot completed successfully. Nov 03 08:31:53 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8337a009-4576-4bff-8bf2-3d2b415d1c8f tempest-CinderUnicodeTest-1549750699 None] Lock "cinder-825015c1-6e68-45ca-a10a-a6ad5d9b8378-delete_snapshot" released by "delete_snapshot" :: held 1.612s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:31:53 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0e9ad80-6c79-4072-adb4-c92340b4ebd3 1073741824" returned: 0 in 0.418s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0e9ad80-6c79-4072-adb4-c92340b4ebd3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:53 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0e9ad80-6c79-4072-adb4-c92340b4ebd3 Nov 03 08:31:53 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:53 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0e9ad80-6c79-4072-adb4-c92340b4ebd3" returned: 0 in 0.250s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:31:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:53 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Attempting download of f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1 ((None, [{'url': 'file:///opt/stack/data/glance/images/f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1', 'metadata': {}}])) to volume f0e9ad80-6c79-4072-adb4-c92340b4ebd3. {{(pid=86801) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 08:31:53 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ccc49483-1a2b-4e55-9dc1-fc440eb74335 tempest-CinderUnicodeTest-1549750699 None] Acquiring lock "cinder-ef0e2bce-4e57-446f-b007-a77c89afceea-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:31:53 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da43816-0d95-4b7f-996a-21e3da1a05de]: (4, 'raw') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:31:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_qo0wy9mo {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:53 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ccc49483-1a2b-4e55-9dc1-fc440eb74335 tempest-CinderUnicodeTest-1549750699 None] Lock "cinder-ef0e2bce-4e57-446f-b007-a77c89afceea-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:31:54 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ccc49483-1a2b-4e55-9dc1-fc440eb74335 tempest-CinderUnicodeTest-1549750699 None] Acquiring lock "cinder-quobyte-ef0e2bce-4e57-446f-b007-a77c89afceea" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:31:54 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ccc49483-1a2b-4e55-9dc1-fc440eb74335 tempest-CinderUnicodeTest-1549750699 None] Lock "cinder-quobyte-ef0e2bce-4e57-446f-b007-a77c89afceea" acquired by "delete_volume" :: waited 0.013s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:31:54 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[559acb6e-c963-4930-b86b-f2b3f2cbe1f3]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:31:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ccc49483-1a2b-4e55-9dc1-fc440eb74335 tempest-CinderUnicodeTest-1549750699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:54 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_qo0wy9mo Nov 03 08:31:54 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:54 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea Nov 03 08:31:54 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:54 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_qo0wy9mo" returned: 0 in 0.350s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_qo0wy9mo {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:54 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_qo0wy9mo Nov 03 08:31:54 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:54 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ccc49483-1a2b-4e55-9dc1-fc440eb74335 tempest-CinderUnicodeTest-1549750699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea" returned: 0 in 0.383s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ccc49483-1a2b-4e55-9dc1-fc440eb74335 tempest-CinderUnicodeTest-1549750699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:54 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea Nov 03 08:31:54 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:54 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_qo0wy9mo" returned: 1 in 0.337s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_qo0wy9mo' failed. Not Retrying. {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 08:31:54 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddea154c-fb83-4362-aa88-42ca9a95d4a1]: (4, 'raw') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:31:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_zijpj9s_devstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:54 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ccc49483-1a2b-4e55-9dc1-fc440eb74335 tempest-CinderUnicodeTest-1549750699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ef0e2bce-4e57-446f-b007-a77c89afceea" returned: 0 in 0.247s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:54 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ccc49483-1a2b-4e55-9dc1-fc440eb74335 tempest-CinderUnicodeTest-1549750699 None] Lock "cinder-quobyte-ef0e2bce-4e57-446f-b007-a77c89afceea" released by "delete_volume" :: held 0.697s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:31:54 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_zijpj9s_devstack@QuobyteHD Nov 03 08:31:54 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:54 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-ccc49483-1a2b-4e55-9dc1-fc440eb74335 tempest-CinderUnicodeTest-1549750699 None] Created reservations ['773bfede-1354-4dcc-ad76-30c3e141de4c', '4d007abe-b8fb-4573-9c23-26fa308225c8', '634be6d4-55a5-4317-be0c-4afadd53b9b2', '6b777995-309b-4c5d-80dc-3b81100797fb'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:31:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ccc49483-1a2b-4e55-9dc1-fc440eb74335 tempest-CinderUnicodeTest-1549750699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ccc49483-1a2b-4e55-9dc1-fc440eb74335 tempest-CinderUnicodeTest-1549750699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ccc49483-1a2b-4e55-9dc1-fc440eb74335 tempest-CinderUnicodeTest-1549750699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:31:54 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ccc49483-1a2b-4e55-9dc1-fc440eb74335 tempest-CinderUnicodeTest-1549750699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:31:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ccc49483-1a2b-4e55-9dc1-fc440eb74335 tempest-CinderUnicodeTest-1549750699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ccc49483-1a2b-4e55-9dc1-fc440eb74335 tempest-CinderUnicodeTest-1549750699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:54 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:31:54 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:54 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_zijpj9s_devstack@QuobyteHD" returned: 0 in 0.328s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_zijpj9s_devstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:55 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:55 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_zijpj9s_devstack@QuobyteHD Nov 03 08:31:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ccc49483-1a2b-4e55-9dc1-fc440eb74335 tempest-CinderUnicodeTest-1549750699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.265s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:55 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:55 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-ccc49483-1a2b-4e55-9dc1-fc440eb74335 tempest-CinderUnicodeTest-1549750699 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:31:55 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9e7bd47b-c3b0-40de-a603-aea6583e117e tempest-CinderUnicodeTest-1549750699 None] Acquiring lock "cinder-fbc9b45e-6a32-4460-846c-3391da515c93-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:31:55 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-ccc49483-1a2b-4e55-9dc1-fc440eb74335 tempest-CinderUnicodeTest-1549750699 None] Deleted volume successfully. Nov 03 08:31:55 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9e7bd47b-c3b0-40de-a603-aea6583e117e tempest-CinderUnicodeTest-1549750699 None] Lock "cinder-fbc9b45e-6a32-4460-846c-3391da515c93-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:31:55 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ccc49483-1a2b-4e55-9dc1-fc440eb74335 tempest-CinderUnicodeTest-1549750699 None] Lock "cinder-ef0e2bce-4e57-446f-b007-a77c89afceea-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:31:55 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9e7bd47b-c3b0-40de-a603-aea6583e117e tempest-CinderUnicodeTest-1549750699 None] Acquiring lock "cinder-quobyte-fbc9b45e-6a32-4460-846c-3391da515c93" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:31:55 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9e7bd47b-c3b0-40de-a603-aea6583e117e tempest-CinderUnicodeTest-1549750699 None] Lock "cinder-quobyte-fbc9b45e-6a32-4460-846c-3391da515c93" acquired by "delete_volume" :: waited 0.019s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:31:55 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[515b2f90-cf62-4398-9f77-a591635e3d87]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:31:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9e7bd47b-c3b0-40de-a603-aea6583e117e tempest-CinderUnicodeTest-1549750699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-fbc9b45e-6a32-4460-846c-3391da515c93 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:55 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-fbc9b45e-6a32-4460-846c-3391da515c93 Nov 03 08:31:55 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:55 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_zijpj9s_devstack@QuobyteHD" returned: 1 in 0.393s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_zijpj9s_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 08:31:55 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1 was raw, converting to qcow2 {{(pid=86801) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 08:31:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_zijpj9s_devstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0e9ad80-6c79-4072-adb4-c92340b4ebd3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:55 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_zijpj9s_devstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0e9ad80-6c79-4072-adb4-c92340b4ebd3 Nov 03 08:31:55 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:55 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9e7bd47b-c3b0-40de-a603-aea6583e117e tempest-CinderUnicodeTest-1549750699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-fbc9b45e-6a32-4460-846c-3391da515c93" returned: 0 in 0.383s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9e7bd47b-c3b0-40de-a603-aea6583e117e tempest-CinderUnicodeTest-1549750699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-fbc9b45e-6a32-4460-846c-3391da515c93 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:55 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-fbc9b45e-6a32-4460-846c-3391da515c93 Nov 03 08:31:55 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:55 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_zijpj9s_devstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0e9ad80-6c79-4072-adb4-c92340b4ebd3" returned: 0 in 0.440s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:55 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1_zijpj9s_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0e9ad80-6c79-4072-adb4-c92340b4ebd3 {{(pid=86801) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 08:31:55 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 08:31:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0e9ad80-6c79-4072-adb4-c92340b4ebd3 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:55 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0e9ad80-6c79-4072-adb4-c92340b4ebd3 1G Nov 03 08:31:55 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:55 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:55 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9e7bd47b-c3b0-40de-a603-aea6583e117e tempest-CinderUnicodeTest-1549750699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-fbc9b45e-6a32-4460-846c-3391da515c93" returned: 0 in 0.274s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:55 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9e7bd47b-c3b0-40de-a603-aea6583e117e tempest-CinderUnicodeTest-1549750699 None] Lock "cinder-quobyte-fbc9b45e-6a32-4460-846c-3391da515c93" released by "delete_volume" :: held 0.703s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:31:55 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-9e7bd47b-c3b0-40de-a603-aea6583e117e tempest-CinderUnicodeTest-1549750699 None] Created reservations ['4acfdbd6-efc2-4620-af14-3c6071c421f9', '0dcb7f93-f71f-47c8-8e81-fc01f8d7bcd9', '85647f2b-7391-40be-b0f5-eb21b31a4a6b', '891c4164-fb41-4454-b623-54641894a745'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:31:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9e7bd47b-c3b0-40de-a603-aea6583e117e tempest-CinderUnicodeTest-1549750699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9e7bd47b-c3b0-40de-a603-aea6583e117e tempest-CinderUnicodeTest-1549750699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:56 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9e7bd47b-c3b0-40de-a603-aea6583e117e tempest-CinderUnicodeTest-1549750699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:31:56 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-9e7bd47b-c3b0-40de-a603-aea6583e117e tempest-CinderUnicodeTest-1549750699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:31:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-9e7bd47b-c3b0-40de-a603-aea6583e117e tempest-CinderUnicodeTest-1549750699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9e7bd47b-c3b0-40de-a603-aea6583e117e tempest-CinderUnicodeTest-1549750699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:56 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:31:56 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:56 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0e9ad80-6c79-4072-adb4-c92340b4ebd3 1G" returned: 0 in 0.333s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:56 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Downloaded image f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1 ((None, [{'url': 'file:///opt/stack/data/glance/images/f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1', 'metadata': {}}])) to volume f0e9ad80-6c79-4072-adb4-c92340b4ebd3 successfully. {{(pid=86801) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 08:31:56 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Temporary image f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1 for user 4ab538111a8c436ba9da32f1beaba764 is deleted. {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 08:31:56 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Marking volume f0e9ad80-6c79-4072-adb4-c92340b4ebd3 as bootable. {{(pid=86801) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 08:31:56 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Copying metadata from image f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1 to f0e9ad80-6c79-4072-adb4-c92340b4ebd3. {{(pid=86801) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 08:31:56 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Creating volume glance metadata for volume f0e9ad80-6c79-4072-adb4-c92340b4ebd3 backed by image f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1 with: {'image_id': 'f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2e1c1ab220a87589e066e488469096f6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86801) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 08:31:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae9207a9-538c-4c66-9b85-08f1df33ffc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0e9ad80-6c79-4072-adb4-c92340b4ebd3', 'volume_size': 1, 'image_id': 'f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2e1c1ab220a87589e066e488469096f6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b8ae2fb9cfc9445d832461212feca63d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd86d1aa8a58224c7f678c6006580b400a0eeeb2e38283297ae8f0a0c87c2471a9a59fe8984d86da478465ff6f2bccbdbcdb2d7496eee6cfd1d90bff9490a099c', 'id': 'f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1', 'created_at': datetime.datetime(2026, 11, 3, 7, 31, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 31, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6e4e3a5-c8f1-4703-af55-8fb5122e2ae1/file', 'properties': {}}, 'image_service': }' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a11f3ae-9064-40ea-8c91-287a64af7aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:31:56 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Volume volume-f0e9ad80-6c79-4072-adb4-c92340b4ebd3 (f0e9ad80-6c79-4072-adb4-c92340b4ebd3): created successfully Nov 03 08:31:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a11f3ae-9064-40ea-8c91-287a64af7aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:31:56 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Flow 'volume_create_manager' (32122063-8d19-4650-8cd8-bf7ea50c8c60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:31:56 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9e7bd47b-c3b0-40de-a603-aea6583e117e tempest-CinderUnicodeTest-1549750699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.281s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:56 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-9e7bd47b-c3b0-40de-a603-aea6583e117e tempest-CinderUnicodeTest-1549750699 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:31:56 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-fb405888-5915-46ae-815f-5cbdd9572014 tempest-VolumeImageDependencyTests-331399195 None] Created volume successfully. Nov 03 08:31:56 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-9e7bd47b-c3b0-40de-a603-aea6583e117e tempest-CinderUnicodeTest-1549750699 None] Deleted volume successfully. Nov 03 08:31:56 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9e7bd47b-c3b0-40de-a603-aea6583e117e tempest-CinderUnicodeTest-1549750699 None] Lock "cinder-fbc9b45e-6a32-4460-846c-3391da515c93-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:31:56 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8306fb8b-e9e9-4601-9c6e-bf97727cbff6 tempest-VolumeImageDependencyTests-331399195 None] Acquiring lock "cinder-f0e9ad80-6c79-4072-adb4-c92340b4ebd3-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:31:56 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8306fb8b-e9e9-4601-9c6e-bf97727cbff6 tempest-VolumeImageDependencyTests-331399195 None] Lock "cinder-f0e9ad80-6c79-4072-adb4-c92340b4ebd3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:31:56 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8306fb8b-e9e9-4601-9c6e-bf97727cbff6 tempest-VolumeImageDependencyTests-331399195 None] Acquiring lock "cinder-quobyte-f0e9ad80-6c79-4072-adb4-c92340b4ebd3" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:31:56 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8306fb8b-e9e9-4601-9c6e-bf97727cbff6 tempest-VolumeImageDependencyTests-331399195 None] Lock "cinder-quobyte-f0e9ad80-6c79-4072-adb4-c92340b4ebd3" acquired by "delete_volume" :: waited 0.016s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:31:56 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e87ffa6-92f0-4d47-bfa2-05f44c777335]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:31:56 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8306fb8b-e9e9-4601-9c6e-bf97727cbff6 tempest-VolumeImageDependencyTests-331399195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0e9ad80-6c79-4072-adb4-c92340b4ebd3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:56 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0e9ad80-6c79-4072-adb4-c92340b4ebd3 Nov 03 08:31:56 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:57 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8306fb8b-e9e9-4601-9c6e-bf97727cbff6 tempest-VolumeImageDependencyTests-331399195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0e9ad80-6c79-4072-adb4-c92340b4ebd3" returned: 0 in 0.376s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8306fb8b-e9e9-4601-9c6e-bf97727cbff6 tempest-VolumeImageDependencyTests-331399195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0e9ad80-6c79-4072-adb4-c92340b4ebd3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:57 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0e9ad80-6c79-4072-adb4-c92340b4ebd3 Nov 03 08:31:57 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:57 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8306fb8b-e9e9-4601-9c6e-bf97727cbff6 tempest-VolumeImageDependencyTests-331399195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f0e9ad80-6c79-4072-adb4-c92340b4ebd3" returned: 0 in 0.264s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:57 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8306fb8b-e9e9-4601-9c6e-bf97727cbff6 tempest-VolumeImageDependencyTests-331399195 None] Lock "cinder-quobyte-f0e9ad80-6c79-4072-adb4-c92340b4ebd3" released by "delete_volume" :: held 0.693s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:31:57 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-8306fb8b-e9e9-4601-9c6e-bf97727cbff6 tempest-VolumeImageDependencyTests-331399195 None] Created reservations ['84e2ced2-585a-4ecc-8c72-a38f269dfd36', '728d9203-2cc8-440a-84e1-f9511ba6195c', '30cc404a-705c-42f9-89a2-17cb2b0e80dc', '43496c6b-0528-4dfd-b029-8935f42c078f'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:31:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8306fb8b-e9e9-4601-9c6e-bf97727cbff6 tempest-VolumeImageDependencyTests-331399195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:31:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8306fb8b-e9e9-4601-9c6e-bf97727cbff6 tempest-VolumeImageDependencyTests-331399195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:31:57 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8306fb8b-e9e9-4601-9c6e-bf97727cbff6 tempest-VolumeImageDependencyTests-331399195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:31:57 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8306fb8b-e9e9-4601-9c6e-bf97727cbff6 tempest-VolumeImageDependencyTests-331399195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:31:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8306fb8b-e9e9-4601-9c6e-bf97727cbff6 tempest-VolumeImageDependencyTests-331399195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:31:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8306fb8b-e9e9-4601-9c6e-bf97727cbff6 tempest-VolumeImageDependencyTests-331399195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:31:57 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:31:57 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:31:57 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Nov 03 08:31:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8306fb8b-e9e9-4601-9c6e-bf97727cbff6 tempest-VolumeImageDependencyTests-331399195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.260s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:31:57 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-8306fb8b-e9e9-4601-9c6e-bf97727cbff6 tempest-VolumeImageDependencyTests-331399195 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:31:57 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-8306fb8b-e9e9-4601-9c6e-bf97727cbff6 tempest-VolumeImageDependencyTests-331399195 None] Deleted volume successfully. Nov 03 08:31:57 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8306fb8b-e9e9-4601-9c6e-bf97727cbff6 tempest-VolumeImageDependencyTests-331399195 None] Lock "cinder-f0e9ad80-6c79-4072-adb4-c92340b4ebd3-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:03 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:32:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:03 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:32:03 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:03 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.241s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:03 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:32:03 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager._thread_info {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:32:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread count: 29 {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 08:32:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread info: [<_MainThread(MainThread, started 139707544170624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 08:32:07 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=98,cinder:UPDATE=112,cinder:INSERT=26,cinder:DELETE=9 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:32:07 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:UPDATE=122,cinder:SELECT=81,cinder:INSERT=37,cinder:DELETE=11 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Flow 'volume_create_manager' (cd460ca9-eafc-4d85-8245-c00a63bc89a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a52796-ed8e-4e8b-a0c2-761458e75eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a52796-ed8e-4e8b-a0c2-761458e75eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-83118512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=906a48dc-3259-4205-b881-b9b4eabed7bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d6e8a8ca2748579339b7b4b4fa0c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:14Z,use_quota=True,user_id='54c6cf2c9bab4fefa78777fc38f499f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a78341-7bb6-462b-bee5-2d9e005ed2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a78341-7bb6-462b-bee5-2d9e005ed2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (665a0072-7e7b-4a2a-be9f-8a5eac900b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (665a0072-7e7b-4a2a-be9f-8a5eac900b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '906a48dc-3259-4205-b881-b9b4eabed7bd', 'volume_name': 'volume-906a48dc-3259-4205-b881-b9b4eabed7bd', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a14cb2f5-cc91-4a9e-a8a0-8da5ffe5fe62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a14cb2f5-cc91-4a9e-a8a0-8da5ffe5fe62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (031b5afa-59a7-48ff-be2a-b35d8b628608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:14 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Volume 906a48dc-3259-4205-b881-b9b4eabed7bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-906a48dc-3259-4205-b881-b9b4eabed7bd', 'volume_size': 1} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-83118512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=906a48dc-3259-4205-b881-b9b4eabed7bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d6e8a8ca2748579339b7b4b4fa0c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:14Z,use_quota=True,user_id='54c6cf2c9bab4fefa78777fc38f499f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Creating volume 906a48dc-3259-4205-b881-b9b4eabed7bd {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:32:14 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:14 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd 1073741824 Nov 03 08:32:14 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Flow 'volume_create_manager' (15e9bc73-2588-4747-8ba5-4a6bf281bc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf1bdcf9-9206-4aa1-9c11-a9af709b7e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf1bdcf9-9206-4aa1-9c11-a9af709b7e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1903751178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=601d2c49-10fb-4a98-8191-7bed9cca8ce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='210d4e9d799e42979f41567e62d31d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:15Z,use_quota=True,user_id='16c48cb408c142e8945c18455e9312ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e7d894c-f51a-4546-b255-c86a03fdccb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e7d894c-f51a-4546-b255-c86a03fdccb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31e6d4e-2091-4283-b941-2fc4ba6578a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31e6d4e-2091-4283-b941-2fc4ba6578a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '601d2c49-10fb-4a98-8191-7bed9cca8ce8', 'volume_name': 'volume-601d2c49-10fb-4a98-8191-7bed9cca8ce8', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca140365-f2b8-4c18-b051-d30f02d2655b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca140365-f2b8-4c18-b051-d30f02d2655b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b88176fd-b42f-4ecf-8535-f7a8953a2514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:14 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Volume 601d2c49-10fb-4a98-8191-7bed9cca8ce8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-601d2c49-10fb-4a98-8191-7bed9cca8ce8', 'volume_size': 1} Nov 03 08:32:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:32:15 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Flow 'volume_create_manager' (52e00935-783f-4e1d-9b21-1fd29ec265bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa507be4-e787-4d63-bfac-acfe1e1deebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd 1073741824" returned: 0 in 0.626s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa507be4-e787-4d63-bfac-acfe1e1deebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2fab205-f36b-4c77-9fc9-38bae1241b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1196e9cf85f44659076ff8494a40b6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:15Z,use_quota=True,user_id='fc5211be66644910a1e23f31550c17ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f80ea89-5db2-48ba-a09e-8007a5429e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f80ea89-5db2-48ba-a09e-8007a5429e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a749064d-2cb8-409a-bdb6-4daa0b5fd51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a749064d-2cb8-409a-bdb6-4daa0b5fd51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2fab205-f36b-4c77-9fc9-38bae1241b47', 'volume_name': 'volume-f2fab205-f36b-4c77-9fc9-38bae1241b47', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd8db4e7-9c90-427b-9f04-16dc7dd29957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd8db4e7-9c90-427b-9f04-16dc7dd29957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18c9a7e-0918-4caa-935e-1769ba2cb48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:15 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Volume f2fab205-f36b-4c77-9fc9-38bae1241b47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2fab205-f36b-4c77-9fc9-38bae1241b47', 'volume_size': 1} Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:15 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd Nov 03 08:32:15 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:15 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd" returned: 0 in 0.276s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.707s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1903751178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=601d2c49-10fb-4a98-8191-7bed9cca8ce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='210d4e9d799e42979f41567e62d31d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:15Z,use_quota=True,user_id='16c48cb408c142e8945c18455e9312ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Creating volume 601d2c49-10fb-4a98-8191-7bed9cca8ce8 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:32:15 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-601d2c49-10fb-4a98-8191-7bed9cca8ce8 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:15 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-601d2c49-10fb-4a98-8191-7bed9cca8ce8 1073741824 Nov 03 08:32:15 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (031b5afa-59a7-48ff-be2a-b35d8b628608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-906a48dc-3259-4205-b881-b9b4eabed7bd', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d041fa0-61f5-4373-8086-3fd404d2763a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:15 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Volume volume-906a48dc-3259-4205-b881-b9b4eabed7bd (906a48dc-3259-4205-b881-b9b4eabed7bd): created successfully Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d041fa0-61f5-4373-8086-3fd404d2763a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Flow 'volume_create_manager' (cd460ca9-eafc-4d85-8245-c00a63bc89a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:15 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-78ee454d-3987-4399-9f62-760b0899563f tempest-CreateVolumesFromSnapshotTest-494543545 None] Created volume successfully. Nov 03 08:32:16 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-601d2c49-10fb-4a98-8191-7bed9cca8ce8 1073741824" returned: 0 in 0.460s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-601d2c49-10fb-4a98-8191-7bed9cca8ce8 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:16 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-601d2c49-10fb-4a98-8191-7bed9cca8ce8 Nov 03 08:32:16 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:16 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-601d2c49-10fb-4a98-8191-7bed9cca8ce8" returned: 0 in 0.266s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:32:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.082s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2fab205-f36b-4c77-9fc9-38bae1241b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1196e9cf85f44659076ff8494a40b6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:15Z,use_quota=True,user_id='fc5211be66644910a1e23f31550c17ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:32:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Creating volume f2fab205-f36b-4c77-9fc9-38bae1241b47 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:32:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:32:16 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:32:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f2fab205-f36b-4c77-9fc9-38bae1241b47 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b88176fd-b42f-4ecf-8535-f7a8953a2514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-601d2c49-10fb-4a98-8191-7bed9cca8ce8', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1538d8d9-4a3d-4ae7-9399-59a44e92a9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:16 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f2fab205-f36b-4c77-9fc9-38bae1241b47 1073741824 Nov 03 08:32:16 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:16 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Volume volume-601d2c49-10fb-4a98-8191-7bed9cca8ce8 (601d2c49-10fb-4a98-8191-7bed9cca8ce8): created successfully Nov 03 08:32:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1538d8d9-4a3d-4ae7-9399-59a44e92a9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:16 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Flow 'volume_create_manager' (15e9bc73-2588-4747-8ba5-4a6bf281bc8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:16 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-341e44cc-630a-41bf-a2b8-1acb72f3a415 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Created volume successfully. Nov 03 08:32:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6bbd5692-7ca1-4df6-94a9-9c4526327ea2 tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:16 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f2fab205-f36b-4c77-9fc9-38bae1241b47 1073741824" returned: 0 in 0.622s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f2fab205-f36b-4c77-9fc9-38bae1241b47 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:17 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f2fab205-f36b-4c77-9fc9-38bae1241b47 Nov 03 08:32:17 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Flow 'volume_create_manager' (25aa3d03-8c96-455a-be2c-f45da69f0380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9bf159c-031c-454e-b97c-2ba504253197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:17 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9bf159c-031c-454e-b97c-2ba504253197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1276335668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc8bcfe-fe01-4d44-855b-67b73c760d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='210d4e9d799e42979f41567e62d31d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:17Z,use_quota=True,user_id='16c48cb408c142e8945c18455e9312ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad991f57-f08c-4fdd-9ab2-f09f2565662b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad991f57-f08c-4fdd-9ab2-f09f2565662b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5891ca-c28d-447e-975d-583a83abb14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5891ca-c28d-447e-975d-583a83abb14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbc8bcfe-fe01-4d44-855b-67b73c760d70', 'volume_name': 'volume-dbc8bcfe-fe01-4d44-855b-67b73c760d70', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d44e3ee-5b1c-4222-a6e1-3d4406a76861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d44e3ee-5b1c-4222-a6e1-3d4406a76861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30b655a-9503-4cdc-a39e-45697f4145bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:17 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Volume dbc8bcfe-fe01-4d44-855b-67b73c760d70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbc8bcfe-fe01-4d44-855b-67b73c760d70', 'volume_size': 1} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f2fab205-f36b-4c77-9fc9-38bae1241b47" returned: 0 in 0.513s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6bbd5692-7ca1-4df6-94a9-9c4526327ea2 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.586s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18c9a7e-0918-4caa-935e-1769ba2cb48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2fab205-f36b-4c77-9fc9-38bae1241b47', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ce2a68-7243-4b4b-acc9-ce0792271764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-6bbd5692-7ca1-4df6-94a9-9c4526327ea2 tempest-CreateVolumesFromSnapshotTest-494543545 None] Creating offline snapshot c154f612-68ef-48f7-8394-dce9246de819 of volume 906a48dc-3259-4205-b881-b9b4eabed7bd {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:32:17 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Volume volume-f2fab205-f36b-4c77-9fc9-38bae1241b47 (f2fab205-f36b-4c77-9fc9-38bae1241b47): created successfully Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ce2a68-7243-4b4b-acc9-ce0792271764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Flow 'volume_create_manager' (52e00935-783f-4e1d-9b21-1fd29ec265bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[01697652-1f3c-481c-989a-2c806bd4e422]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6bbd5692-7ca1-4df6-94a9-9c4526327ea2 tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:17 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-708950b6-1163-4776-8248-15b8c5ead6a9 tempest-CinderUnicodeTest-1776522857 None] Created volume successfully. Nov 03 08:32:17 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd Nov 03 08:32:17 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Flow 'volume_create_manager' (0151e8e4-5898-4409-867a-94fc54935381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a93bf35-797a-4da8-a63e-975e94d67cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a93bf35-797a-4da8-a63e-975e94d67cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-632546839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df2b0721-3cc9-4478-a98e-8cc34f1d1e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='210d4e9d799e42979f41567e62d31d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:18Z,use_quota=True,user_id='16c48cb408c142e8945c18455e9312ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (217c1554-2b5d-4de7-8ee6-4833d01c7889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (217c1554-2b5d-4de7-8ee6-4833d01c7889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49fd971e-6ff1-4e4e-94b4-edcdf373319d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49fd971e-6ff1-4e4e-94b4-edcdf373319d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df2b0721-3cc9-4478-a98e-8cc34f1d1e0b', 'volume_name': 'volume-df2b0721-3cc9-4478-a98e-8cc34f1d1e0b', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac2c975d-3e49-437b-ab7d-b44a11e2b072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac2c975d-3e49-437b-ab7d-b44a11e2b072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3370dfa4-c87e-43e9-9332-95945f30f85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:17 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Volume df2b0721-3cc9-4478-a98e-8cc34f1d1e0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df2b0721-3cc9-4478-a98e-8cc34f1d1e0b', 'volume_size': 1} Nov 03 08:32:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:18 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6bbd5692-7ca1-4df6-94a9-9c4526327ea2 tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd" returned: 0 in 0.484s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6bbd5692-7ca1-4df6-94a9-9c4526327ea2 tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd.c154f612-68ef-48f7-8394-dce9246de819 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:18 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd.c154f612-68ef-48f7-8394-dce9246de819 1G Nov 03 08:32:18 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Flow 'volume_create_manager' (90d6c8b1-b3bd-4076-b46a-b6eb0f00a74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e3bea8-fa82-4cbe-825d-8bb4e0b30d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e3bea8-fa82-4cbe-825d-8bb4e0b30d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2119793784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a048870-5f3a-492a-bb26-8163581a7815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='210d4e9d799e42979f41567e62d31d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:18Z,use_quota=True,user_id='16c48cb408c142e8945c18455e9312ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (693b3df4-d786-4d11-98b5-d334c22651f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (693b3df4-d786-4d11-98b5-d334c22651f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb2bc85-98d2-40d6-9980-657558ff53fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb2bc85-98d2-40d6-9980-657558ff53fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a048870-5f3a-492a-bb26-8163581a7815', 'volume_name': 'volume-8a048870-5f3a-492a-bb26-8163581a7815', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940590ce-1a95-4073-afa5-7ec3b0b3ef3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940590ce-1a95-4073-afa5-7ec3b0b3ef3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdca7150-c419-4691-9d85-4e80814b4354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:18 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Volume 8a048870-5f3a-492a-bb26-8163581a7815: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a048870-5f3a-492a-bb26-8163581a7815', 'volume_size': 1} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Flow 'volume_create_manager' (458172e5-9f57-4067-be27-cb370d026d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e8d1459-4d51-4918-9d55-3de72827264f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e8d1459-4d51-4918-9d55-3de72827264f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=263fab68-bf71-4e3f-a861-9e041c0d8996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c175eb77c8c74e00b65ef1a449392a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:18Z,use_quota=True,user_id='bc583d59422b43c09b0de4835538a3e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57e0eaa8-37a0-4418-bc46-779358f506f7),volume_type_id=57e0eaa8-37a0-4418-bc46-779358f506f7)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0628807-cf2d-41cc-9f82-e3c5d1c6e9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0628807-cf2d-41cc-9f82-e3c5d1c6e9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0e8a27-b043-463e-96a7-c861213188dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.image.glance [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Creating Keystone auth plugin from conf {{(pid=86801) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 08:32:18 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6bbd5692-7ca1-4df6-94a9-9c4526327ea2 tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd.c154f612-68ef-48f7-8394-dce9246de819 1G" returned: 0 in 0.548s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6bbd5692-7ca1-4df6-94a9-9c4526327ea2 tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-906a48dc-3259-4205-b881-b9b4eabed7bd -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd.c154f612-68ef-48f7-8394-dce9246de819 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:18 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-906a48dc-3259-4205-b881-b9b4eabed7bd -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd.c154f612-68ef-48f7-8394-dce9246de819 Nov 03 08:32:18 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Flow 'volume_create_manager' (9aa48420-0a6c-4f73-9f56-8ab313190ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a9e563-dc70-4d8f-8503-45bace46f8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a9e563-dc70-4d8f-8503-45bace46f8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-29182833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e6722c-e028-4595-9ad2-47f944863124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='210d4e9d799e42979f41567e62d31d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:19Z,use_quota=True,user_id='16c48cb408c142e8945c18455e9312ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99e1f01-f8b8-4f62-9f32-4a2575ff4194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99e1f01-f8b8-4f62-9f32-4a2575ff4194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ede9af8-5b23-4c0d-9895-1763adc8df0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ede9af8-5b23-4c0d-9895-1763adc8df0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0e6722c-e028-4595-9ad2-47f944863124', 'volume_name': 'volume-a0e6722c-e028-4595-9ad2-47f944863124', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eefdc6c7-cde3-4f30-a64a-11e75ca96df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eefdc6c7-cde3-4f30-a64a-11e75ca96df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (440109df-b1c4-4ccb-9034-38d687759fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:18 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Volume a0e6722c-e028-4595-9ad2-47f944863124: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0e6722c-e028-4595-9ad2-47f944863124', 'volume_size': 1} Nov 03 08:32:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0e8a27-b043-463e-96a7-c861213188dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '263fab68-bf71-4e3f-a861-9e041c0d8996', 'volume_name': 'volume-263fab68-bf71-4e3f-a861-9e041c0d8996', 'volume_size': 1, 'image_id': 'cca0f906-87ab-4f4f-bb41-8fe1e04a9975', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cca0f906-87ab-4f4f-bb41-8fe1e04a9975', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3124657360655c5aca01fa3777aa9feb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c175eb77c8c74e00b65ef1a449392a72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '04046511fe7d248edee8fa30c039c3f94c8598ee4142e4c3eeb63bea0e9abe0d0c4a565c24d2d55e1b7c328f446db9a8bb6addc019bc965b99c4df9bfe6dcc35', 'id': 'cca0f906-87ab-4f4f-bb41-8fe1e04a9975', 'created_at': datetime.datetime(2026, 11, 3, 7, 32, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 32, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cca0f906-87ab-4f4f-bb41-8fe1e04a9975/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (061ed26d-f1d3-4dfc-9d28-eeca3c60e506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (061ed26d-f1d3-4dfc-9d28-eeca3c60e506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f221f2d0-a471-4623-9f8d-855c0835a19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:19 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Volume 263fab68-bf71-4e3f-a861-9e041c0d8996: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-263fab68-bf71-4e3f-a861-9e041c0d8996', 'volume_size': 1, 'image_id': 'cca0f906-87ab-4f4f-bb41-8fe1e04a9975', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cca0f906-87ab-4f4f-bb41-8fe1e04a9975', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3124657360655c5aca01fa3777aa9feb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c175eb77c8c74e00b65ef1a449392a72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '04046511fe7d248edee8fa30c039c3f94c8598ee4142e4c3eeb63bea0e9abe0d0c4a565c24d2d55e1b7c328f446db9a8bb6addc019bc965b99c4df9bfe6dcc35', 'id': 'cca0f906-87ab-4f4f-bb41-8fe1e04a9975', 'created_at': datetime.datetime(2026, 11, 3, 7, 32, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 32, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cca0f906-87ab-4f4f-bb41-8fe1e04a9975/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Trying to clone 263fab68-bf71-4e3f-a861-9e041c0d8996 from image cca0f906-87ab-4f4f-bb41-8fe1e04a9975 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cca0f906-87ab-4f4f-bb41-8fe1e04a9975', 'metadata': {}}]). {{(pid=86801) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 08:32:19 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6bbd5692-7ca1-4df6-94a9-9c4526327ea2 tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-906a48dc-3259-4205-b881-b9b4eabed7bd -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd.c154f612-68ef-48f7-8394-dce9246de819" returned: 0 in 0.470s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:19 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-6bbd5692-7ca1-4df6-94a9-9c4526327ea2 tempest-CreateVolumesFromSnapshotTest-494543545 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd.c154f612-68ef-48f7-8394-dce9246de819 is being set with open permissions: ugo+rw Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6bbd5692-7ca1-4df6-94a9-9c4526327ea2 tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd.c154f612-68ef-48f7-8394-dce9246de819 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:19 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd.c154f612-68ef-48f7-8394-dce9246de819 Nov 03 08:32:19 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_hpaltcnkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 08:32:19 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Image download 0.00 MB at 0.00 MB/s Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[01edf439-3530-4d8b-940b-396ee8a3528a]: (4, 'raw') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_hpaltcnkdevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:19 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_hpaltcnkdevstack@QuobyteHD Nov 03 08:32:19 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:19 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6bbd5692-7ca1-4df6-94a9-9c4526327ea2 tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd.c154f612-68ef-48f7-8394-dce9246de819" returned: 0 in 0.343s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Flow 'volume_create_manager' (72165c5d-904e-4d68-9814-d4fa6e4972b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d985cf93-da3e-4d6f-af9a-eccaee8b8d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6bbd5692-7ca1-4df6-94a9-9c4526327ea2 tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:19 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd.info Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d985cf93-da3e-4d6f-af9a-eccaee8b8d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-211767478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a9c2f4e-aada-4e41-a670-1886d77e5774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='210d4e9d799e42979f41567e62d31d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:19Z,use_quota=True,user_id='16c48cb408c142e8945c18455e9312ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:19 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d46d3d4b-51fe-4931-9ff8-89bf0637757b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d46d3d4b-51fe-4931-9ff8-89bf0637757b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e885c96-81e3-474b-984c-e636d0f09649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:19 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e885c96-81e3-474b-984c-e636d0f09649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a9c2f4e-aada-4e41-a670-1886d77e5774', 'volume_name': 'volume-5a9c2f4e-aada-4e41-a670-1886d77e5774', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745bd510-71ac-497d-b14c-74e1562a5127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745bd510-71ac-497d-b14c-74e1562a5127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d8b069-fc21-458e-8286-aef89cfa0979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:19 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Volume 5a9c2f4e-aada-4e41-a670-1886d77e5774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a9c2f4e-aada-4e41-a670-1886d77e5774', 'volume_size': 1} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_hpaltcnkdevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_hpaltcnkdevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Flow 'volume_create_manager' (80afec13-661d-49f6-9027-b7192cc550f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a8fcf58-621c-4161-9fb7-250976192433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a8fcf58-621c-4161-9fb7-250976192433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1297079446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b544be6-f501-40dc-9608-d8c54cd60d16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1196e9cf85f44659076ff8494a40b6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:20Z,use_quota=True,user_id='fc5211be66644910a1e23f31550c17ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d06a0e4-6e0d-49df-bf94-ecbb34a51afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d06a0e4-6e0d-49df-bf94-ecbb34a51afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56b61cb-6f13-4f2b-8c7b-930f5b5659b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56b61cb-6f13-4f2b-8c7b-930f5b5659b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b544be6-f501-40dc-9608-d8c54cd60d16', 'volume_name': 'volume-9b544be6-f501-40dc-9608-d8c54cd60d16', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c309daf-ea28-4a02-bf33-add32762750a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c309daf-ea28-4a02-bf33-add32762750a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90bcdddb-5e66-42e9-96b3-153695ff34bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:19 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Volume 9b544be6-f501-40dc-9608-d8c54cd60d16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b544be6-f501-40dc-9608-d8c54cd60d16', 'volume_size': 1} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:19 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_hpaltcnkdevstack@QuobyteHD Nov 03 08:32:19 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:19 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6bbd5692-7ca1-4df6-94a9-9c4526327ea2 tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd.info" returned: 0 in 0.264s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:19 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-6bbd5692-7ca1-4df6-94a9-9c4526327ea2 tempest-CreateVolumesFromSnapshotTest-494543545 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd.info is being set with open permissions: ugo+rw Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6bbd5692-7ca1-4df6-94a9-9c4526327ea2 tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:19 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd.info Nov 03 08:32:19 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:19 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_hpaltcnkdevstack@QuobyteHD" returned: 1 in 0.327s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_hpaltcnkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 08:32:19 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Temporary image cca0f906-87ab-4f4f-bb41-8fe1e04a9975 is fetched for user bc583d59422b43c09b0de4835538a3e0. {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8f7d8d-e07b-4dbe-bd2d-3465ceadae90]: (4, 'raw') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_hpaltcnkdevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:20 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6bbd5692-7ca1-4df6-94a9-9c4526327ea2 tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd.info" returned: 0 in 0.258s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6bbd5692-7ca1-4df6-94a9-9c4526327ea2 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.558s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.577s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1276335668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc8bcfe-fe01-4d44-855b-67b73c760d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='210d4e9d799e42979f41567e62d31d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:17Z,use_quota=True,user_id='16c48cb408c142e8945c18455e9312ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Creating volume dbc8bcfe-fe01-4d44-855b-67b73c760d70 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:32:20 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-dbc8bcfe-fe01-4d44-855b-67b73c760d70 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:20 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-dbc8bcfe-fe01-4d44-855b-67b73c760d70 1073741824 Nov 03 08:32:20 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:20 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_hpaltcnkdevstack@QuobyteHD Nov 03 08:32:20 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:20 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-6bbd5692-7ca1-4df6-94a9-9c4526327ea2 tempest-CreateVolumesFromSnapshotTest-494543545 None] Create snapshot completed successfully Nov 03 08:32:20 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_hpaltcnkdevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_hpaltcnkdevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:20 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_hpaltcnkdevstack@QuobyteHD Nov 03 08:32:20 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:20 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-dbc8bcfe-fe01-4d44-855b-67b73c760d70 1073741824" returned: 0 in 0.451s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-dbc8bcfe-fe01-4d44-855b-67b73c760d70 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:20 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-dbc8bcfe-fe01-4d44-855b-67b73c760d70 Nov 03 08:32:20 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:20 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_hpaltcnkdevstack@QuobyteHD" returned: 1 in 0.332s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_hpaltcnkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:20 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-dbc8bcfe-fe01-4d44-855b-67b73c760d70" returned: 0 in 0.252s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.992s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-632546839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df2b0721-3cc9-4478-a98e-8cc34f1d1e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='210d4e9d799e42979f41567e62d31d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:18Z,use_quota=True,user_id='16c48cb408c142e8945c18455e9312ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Creating volume df2b0721-3cc9-4478-a98e-8cc34f1d1e0b {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:32:20 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-df2b0721-3cc9-4478-a98e-8cc34f1d1e0b 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30b655a-9503-4cdc-a39e-45697f4145bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbc8bcfe-fe01-4d44-855b-67b73c760d70', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (544a0eb9-d017-425b-9259-85c48b53469a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:20 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-df2b0721-3cc9-4478-a98e-8cc34f1d1e0b 1073741824 Nov 03 08:32:20 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:20 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Volume volume-dbc8bcfe-fe01-4d44-855b-67b73c760d70 (dbc8bcfe-fe01-4d44-855b-67b73c760d70): created successfully Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (544a0eb9-d017-425b-9259-85c48b53469a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Flow 'volume_create_manager' (25aa3d03-8c96-455a-be2c-f45da69f0380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:20 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-b6dd9333-14a1-46d9-863e-76cafba499b3 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Created volume successfully. Nov 03 08:32:21 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-df2b0721-3cc9-4478-a98e-8cc34f1d1e0b 1073741824" returned: 0 in 0.506s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-df2b0721-3cc9-4478-a98e-8cc34f1d1e0b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:21 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-df2b0721-3cc9-4478-a98e-8cc34f1d1e0b Nov 03 08:32:21 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:21 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-df2b0721-3cc9-4478-a98e-8cc34f1d1e0b" returned: 0 in 0.280s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.368s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2119793784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a048870-5f3a-492a-bb26-8163581a7815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='210d4e9d799e42979f41567e62d31d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:18Z,use_quota=True,user_id='16c48cb408c142e8945c18455e9312ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Creating volume 8a048870-5f3a-492a-bb26-8163581a7815 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:32:21 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8a048870-5f3a-492a-bb26-8163581a7815 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:21 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8a048870-5f3a-492a-bb26-8163581a7815 1073741824 Nov 03 08:32:21 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3370dfa4-c87e-43e9-9332-95945f30f85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df2b0721-3cc9-4478-a98e-8cc34f1d1e0b', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69538226-b5e2-4947-9f0e-e59b47c0a54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:21 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Volume volume-df2b0721-3cc9-4478-a98e-8cc34f1d1e0b (df2b0721-3cc9-4478-a98e-8cc34f1d1e0b): created successfully Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69538226-b5e2-4947-9f0e-e59b47c0a54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Flow 'volume_create_manager' (0151e8e4-5898-4409-867a-94fc54935381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Flow 'volume_create_manager' (a58b48a7-7d66-4f81-a60c-2419b3898139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbaa21de-a0a8-4e07-870a-9a4840d8dd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:21 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-7733bcdf-1294-49e6-a7f7-d77b91e28ae2 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Created volume successfully. Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbaa21de-a0a8-4e07-870a-9a4840d8dd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-102360111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb0491f-18a1-4b3a-b5aa-2182d75b7e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d6e8a8ca2748579339b7b4b4fa0c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:22Z,use_quota=True,user_id='54c6cf2c9bab4fefa78777fc38f499f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27be0d2c-7862-4b29-aaa4-38f4df977cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27be0d2c-7862-4b29-aaa4-38f4df977cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb749f09-1774-4954-a446-333a39861ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb749f09-1774-4954-a446-333a39861ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfb0491f-18a1-4b3a-b5aa-2182d75b7e89', 'volume_name': 'volume-cfb0491f-18a1-4b3a-b5aa-2182d75b7e89', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd68a047-e800-4973-b614-664ec802867b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd68a047-e800-4973-b614-664ec802867b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d97db2fb-e7c2-4f4c-8ff1-7f1adc410104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:21 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Volume cfb0491f-18a1-4b3a-b5aa-2182d75b7e89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfb0491f-18a1-4b3a-b5aa-2182d75b7e89', 'volume_size': 1} Nov 03 08:32:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Flow 'volume_create_manager' (87f07678-c8da-4197-9bfc-ece8eb1302ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e46b3e7d-228b-47ce-9ef2-37d4958ae679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e46b3e7d-228b-47ce-9ef2-37d4958ae679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-481306269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1209423-4e8a-4260-ad95-b4f64e09e214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d6e8a8ca2748579339b7b4b4fa0c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:22Z,use_quota=True,user_id='54c6cf2c9bab4fefa78777fc38f499f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e679c3-c595-4efb-b761-f90713a08881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:22 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e679c3-c595-4efb-b761-f90713a08881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec05485-44f7-4d21-9c02-4919f9489023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec05485-44f7-4d21-9c02-4919f9489023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1209423-4e8a-4260-ad95-b4f64e09e214', 'volume_name': 'volume-d1209423-4e8a-4260-ad95-b4f64e09e214', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d73fc060-917f-411f-b8f1-3f806094aa22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d73fc060-917f-411f-b8f1-3f806094aa22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b6f810-f22a-4352-b82d-0e7bbcfc06db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:22 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Volume d1209423-4e8a-4260-ad95-b4f64e09e214: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1209423-4e8a-4260-ad95-b4f64e09e214', 'volume_size': 1} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8a048870-5f3a-492a-bb26-8163581a7815 1073741824" returned: 0 in 0.542s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8a048870-5f3a-492a-bb26-8163581a7815 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:22 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8a048870-5f3a-492a-bb26-8163581a7815 Nov 03 08:32:22 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Flow 'volume_create_manager' (f6f9a362-3051-4db3-8ce0-83402792f68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aadedefe-16a0-43e5-a8dc-cdddfedccfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:22 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8a048870-5f3a-492a-bb26-8163581a7815" returned: 0 in 0.297s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.645s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-29182833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e6722c-e028-4595-9ad2-47f944863124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='210d4e9d799e42979f41567e62d31d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:19Z,use_quota=True,user_id='16c48cb408c142e8945c18455e9312ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Creating volume a0e6722c-e028-4595-9ad2-47f944863124 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:32:22 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a0e6722c-e028-4595-9ad2-47f944863124 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aadedefe-16a0-43e5-a8dc-cdddfedccfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1915869060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c832c0c-d9d8-4c3e-8367-8948f7c5a046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d6e8a8ca2748579339b7b4b4fa0c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:23Z,use_quota=True,user_id='54c6cf2c9bab4fefa78777fc38f499f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0be8ca7-b0a7-4146-8334-d934b7ba7a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:22 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a0e6722c-e028-4595-9ad2-47f944863124 1073741824 Nov 03 08:32:22 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0be8ca7-b0a7-4146-8334-d934b7ba7a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9930ba19-9577-460a-900c-6cf79e1a4967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9930ba19-9577-460a-900c-6cf79e1a4967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c832c0c-d9d8-4c3e-8367-8948f7c5a046', 'volume_name': 'volume-3c832c0c-d9d8-4c3e-8367-8948f7c5a046', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f8fa82f-2111-4e48-b545-acdcff5e0ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f8fa82f-2111-4e48-b545-acdcff5e0ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e61da69-316c-4698-bdb9-3142d6169d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:22 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Volume 3c832c0c-d9d8-4c3e-8367-8948f7c5a046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c832c0c-d9d8-4c3e-8367-8948f7c5a046', 'volume_size': 1} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdca7150-c419-4691-9d85-4e80814b4354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a048870-5f3a-492a-bb26-8163581a7815', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad4051f1-129e-447f-9cdb-8814f0f753dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:22 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Volume volume-8a048870-5f3a-492a-bb26-8163581a7815 (8a048870-5f3a-492a-bb26-8163581a7815): created successfully Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad4051f1-129e-447f-9cdb-8814f0f753dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:22 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Flow 'volume_create_manager' (90d6c8b1-b3bd-4076-b46a-b6eb0f00a74e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:22 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-51788614-1936-4469-8f9e-c5941a585239 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Created volume successfully. Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Flow 'volume_create_manager' (1a3c2bc2-ecda-46ac-8e98-5faa190a6863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (154b0c58-f2b3-4a66-9165-a64f82d1b28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (154b0c58-f2b3-4a66-9165-a64f82d1b28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1969403959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd6a61b9-f810-49ab-8c5d-8b22622c6add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d6e8a8ca2748579339b7b4b4fa0c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:23Z,use_quota=True,user_id='54c6cf2c9bab4fefa78777fc38f499f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (001b3361-3c35-40c8-a09c-145c6375e6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (001b3361-3c35-40c8-a09c-145c6375e6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b206f571-1d8f-4504-8020-1007f13d4f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b206f571-1d8f-4504-8020-1007f13d4f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd6a61b9-f810-49ab-8c5d-8b22622c6add', 'volume_name': 'volume-fd6a61b9-f810-49ab-8c5d-8b22622c6add', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b751c81e-03d7-44b7-8f01-29784eb4d646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b751c81e-03d7-44b7-8f01-29784eb4d646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e40e9fc-366c-4974-a9dd-2f8c6ae07c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:23 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Volume fd6a61b9-f810-49ab-8c5d-8b22622c6add: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd6a61b9-f810-49ab-8c5d-8b22622c6add', 'volume_size': 1} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:23 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a0e6722c-e028-4595-9ad2-47f944863124 1073741824" returned: 0 in 0.508s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a0e6722c-e028-4595-9ad2-47f944863124 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:23 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a0e6722c-e028-4595-9ad2-47f944863124 Nov 03 08:32:23 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Flow 'volume_create_manager' (5435b1fb-18eb-4382-8bb7-fad4d747ad21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cbd01e4-49aa-4f51-9a9f-dc2aed60cdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:23 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cbd01e4-49aa-4f51-9a9f-dc2aed60cdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-368845358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64cd0555-5dda-4863-9bf4-56ec5487236e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d6e8a8ca2748579339b7b4b4fa0c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:23Z,use_quota=True,user_id='54c6cf2c9bab4fefa78777fc38f499f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95d3ed9-1c7e-4a48-b947-de670731fe59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95d3ed9-1c7e-4a48-b947-de670731fe59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (861dbd5a-2669-443d-b401-b4de1449ce48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (861dbd5a-2669-443d-b401-b4de1449ce48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64cd0555-5dda-4863-9bf4-56ec5487236e', 'volume_name': 'volume-64cd0555-5dda-4863-9bf4-56ec5487236e', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4595f4-3a67-4ab4-a96a-408712320c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4595f4-3a67-4ab4-a96a-408712320c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352397b3-a59f-4313-92c8-9057cdafc509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:23 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Volume 64cd0555-5dda-4863-9bf4-56ec5487236e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64cd0555-5dda-4863-9bf4-56ec5487236e', 'volume_size': 1} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a0e6722c-e028-4595-9ad2-47f944863124" returned: 0 in 0.304s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.830s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-211767478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a9c2f4e-aada-4e41-a670-1886d77e5774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='210d4e9d799e42979f41567e62d31d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:19Z,use_quota=True,user_id='16c48cb408c142e8945c18455e9312ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Creating volume 5a9c2f4e-aada-4e41-a670-1886d77e5774 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:32:23 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5a9c2f4e-aada-4e41-a670-1886d77e5774 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (440109df-b1c4-4ccb-9034-38d687759fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0e6722c-e028-4595-9ad2-47f944863124', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:23 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5a9c2f4e-aada-4e41-a670-1886d77e5774 1073741824 Nov 03 08:32:23 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7a66c10-b45f-447f-ad92-393da91a659c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:23 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Volume volume-a0e6722c-e028-4595-9ad2-47f944863124 (a0e6722c-e028-4595-9ad2-47f944863124): created successfully Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7a66c10-b45f-447f-ad92-393da91a659c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Flow 'volume_create_manager' (9aa48420-0a6c-4f73-9f56-8ab313190ff7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:23 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-4336bd9e-f435-402c-9ee7-7b0cfee3e934 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Created volume successfully. Nov 03 08:32:23 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5a9c2f4e-aada-4e41-a670-1886d77e5774 1073741824" returned: 0 in 0.439s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5a9c2f4e-aada-4e41-a670-1886d77e5774 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:23 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5a9c2f4e-aada-4e41-a670-1886d77e5774 Nov 03 08:32:23 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:24 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5a9c2f4e-aada-4e41-a670-1886d77e5774" returned: 0 in 0.242s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.447s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1297079446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b544be6-f501-40dc-9608-d8c54cd60d16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1196e9cf85f44659076ff8494a40b6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:20Z,use_quota=True,user_id='fc5211be66644910a1e23f31550c17ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Creating volume 9b544be6-f501-40dc-9608-d8c54cd60d16 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:32:24 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d8b069-fc21-458e-8286-aef89cfa0979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a9c2f4e-aada-4e41-a670-1886d77e5774', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:24 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16 1073741824 Nov 03 08:32:24 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8861e20-bd0f-40c9-840e-de907fbb9863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:24 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Volume volume-5a9c2f4e-aada-4e41-a670-1886d77e5774 (5a9c2f4e-aada-4e41-a670-1886d77e5774): created successfully Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8861e20-bd0f-40c9-840e-de907fbb9863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Flow 'volume_create_manager' (72165c5d-904e-4d68-9814-d4fa6e4972b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:24 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-32b3ec92-93c0-4cc3-ad16-a9a7bfc56f35 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Created volume successfully. Nov 03 08:32:24 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16 1073741824" returned: 0 in 0.415s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:24 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16 Nov 03 08:32:24 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4edf9f02-313e-442a-97a4-7c8da8ede026 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "cinder-5a9c2f4e-aada-4e41-a670-1886d77e5774-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4edf9f02-313e-442a-97a4-7c8da8ede026 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "cinder-5a9c2f4e-aada-4e41-a670-1886d77e5774-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4edf9f02-313e-442a-97a4-7c8da8ede026 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "cinder-quobyte-5a9c2f4e-aada-4e41-a670-1886d77e5774" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:24 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4edf9f02-313e-442a-97a4-7c8da8ede026 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "cinder-quobyte-5a9c2f4e-aada-4e41-a670-1886d77e5774" acquired by "delete_volume" :: waited 0.021s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16" returned: 0 in 0.299s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.212s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=263fab68-bf71-4e3f-a861-9e041c0d8996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c175eb77c8c74e00b65ef1a449392a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:18Z,use_quota=True,user_id='bc583d59422b43c09b0de4835538a3e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57e0eaa8-37a0-4418-bc46-779358f506f7),volume_type_id=57e0eaa8-37a0-4418-bc46-779358f506f7)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Creating volume 263fab68-bf71-4e3f-a861-9e041c0d8996 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:32:24 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-263fab68-bf71-4e3f-a861-9e041c0d8996 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbb4baf-3a4c-4a2b-ba8b-83d6349c75cc]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4edf9f02-313e-442a-97a4-7c8da8ede026 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5a9c2f4e-aada-4e41-a670-1886d77e5774 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:25 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-263fab68-bf71-4e3f-a861-9e041c0d8996 1073741824 Nov 03 08:32:25 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90bcdddb-5e66-42e9-96b3-153695ff34bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b544be6-f501-40dc-9608-d8c54cd60d16', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f65836-88a4-4553-859c-9af882fa8268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:25 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Volume volume-9b544be6-f501-40dc-9608-d8c54cd60d16 (9b544be6-f501-40dc-9608-d8c54cd60d16): created successfully Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f65836-88a4-4553-859c-9af882fa8268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Flow 'volume_create_manager' (80afec13-661d-49f6-9027-b7192cc550f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:25 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-b00dcec5-9569-4ee3-8dda-8ea834746ef1 tempest-CinderUnicodeTest-1776522857 None] Created volume successfully. Nov 03 08:32:25 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5a9c2f4e-aada-4e41-a670-1886d77e5774 Nov 03 08:32:25 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:25 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4edf9f02-313e-442a-97a4-7c8da8ede026 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5a9c2f4e-aada-4e41-a670-1886d77e5774" returned: 0 in 0.389s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4edf9f02-313e-442a-97a4-7c8da8ede026 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5a9c2f4e-aada-4e41-a670-1886d77e5774 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:25 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5a9c2f4e-aada-4e41-a670-1886d77e5774 Nov 03 08:32:25 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:25 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-263fab68-bf71-4e3f-a861-9e041c0d8996 1073741824" returned: 0 in 0.482s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-263fab68-bf71-4e3f-a861-9e041c0d8996 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:25 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-263fab68-bf71-4e3f-a861-9e041c0d8996 Nov 03 08:32:25 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:25 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4edf9f02-313e-442a-97a4-7c8da8ede026 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5a9c2f4e-aada-4e41-a670-1886d77e5774" returned: 0 in 0.280s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4edf9f02-313e-442a-97a4-7c8da8ede026 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "cinder-quobyte-5a9c2f4e-aada-4e41-a670-1886d77e5774" released by "delete_volume" :: held 0.736s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-4edf9f02-313e-442a-97a4-7c8da8ede026 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Created reservations ['3a894742-da5d-42d5-a1fa-80fb841a6db1', '08a241c1-bf5b-47c2-8b00-ac714ec2d031', 'c5068c60-e8eb-47c5-9f46-14c545935b3b', '9a9cebc4-f240-42c2-999e-cda75f0f9f39'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:32:25 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-263fab68-bf71-4e3f-a861-9e041c0d8996" returned: 0 in 0.282s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.858s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-102360111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb0491f-18a1-4b3a-b5aa-2182d75b7e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d6e8a8ca2748579339b7b4b4fa0c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:22Z,use_quota=True,user_id='54c6cf2c9bab4fefa78777fc38f499f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Creating volume cfb0491f-18a1-4b3a-b5aa-2182d75b7e89 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:32:25 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cfb0491f-18a1-4b3a-b5aa-2182d75b7e89 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:25 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cfb0491f-18a1-4b3a-b5aa-2182d75b7e89 1073741824 Nov 03 08:32:25 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Attempting download of cca0f906-87ab-4f4f-bb41-8fe1e04a9975 ((None, [{'url': 'file:///opt/stack/data/glance/images/cca0f906-87ab-4f4f-bb41-8fe1e04a9975', 'metadata': {}}])) to volume 263fab68-bf71-4e3f-a861-9e041c0d8996. {{(pid=86801) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4edf9f02-313e-442a-97a4-7c8da8ede026 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4edf9f02-313e-442a-97a4-7c8da8ede026 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4edf9f02-313e-442a-97a4-7c8da8ede026 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4edf9f02-313e-442a-97a4-7c8da8ede026 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4edf9f02-313e-442a-97a4-7c8da8ede026 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4edf9f02-313e-442a-97a4-7c8da8ede026 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cc0c16-35fa-4169-8e04-b05555ab9635]: (4, 'raw') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_93qsot7u {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:25 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:32:25 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b67d7606-e097-4503-aeaf-738c2becf22f tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "cinder-a0e6722c-e028-4595-9ad2-47f944863124-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b67d7606-e097-4503-aeaf-738c2becf22f tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "cinder-a0e6722c-e028-4595-9ad2-47f944863124-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:26 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_93qsot7u Nov 03 08:32:26 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3afd4c38-c83a-4ef2-a3f9-85546c355885 tempest-CinderUnicodeTest-1776522857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b67d7606-e097-4503-aeaf-738c2becf22f tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "cinder-quobyte-a0e6722c-e028-4595-9ad2-47f944863124" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b67d7606-e097-4503-aeaf-738c2becf22f tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "cinder-quobyte-a0e6722c-e028-4595-9ad2-47f944863124" acquired by "delete_volume" :: waited 0.021s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[784104cb-4ec8-495f-8b91-d118e475ca7a]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b67d7606-e097-4503-aeaf-738c2becf22f tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a0e6722c-e028-4595-9ad2-47f944863124 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:26 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4edf9f02-313e-442a-97a4-7c8da8ede026 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.445s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-4edf9f02-313e-442a-97a4-7c8da8ede026 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:32:26 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-4edf9f02-313e-442a-97a4-7c8da8ede026 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Deleted volume successfully. Nov 03 08:32:26 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4edf9f02-313e-442a-97a4-7c8da8ede026 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "cinder-5a9c2f4e-aada-4e41-a670-1886d77e5774-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cfb0491f-18a1-4b3a-b5aa-2182d75b7e89 1073741824" returned: 0 in 0.582s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:26 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a0e6722c-e028-4595-9ad2-47f944863124 Nov 03 08:32:26 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cfb0491f-18a1-4b3a-b5aa-2182d75b7e89 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:26 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_93qsot7u" returned: 0 in 0.487s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_93qsot7u {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:26 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cfb0491f-18a1-4b3a-b5aa-2182d75b7e89 Nov 03 08:32:26 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:26 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_93qsot7u Nov 03 08:32:26 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:26 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cfb0491f-18a1-4b3a-b5aa-2182d75b7e89" returned: 0 in 0.262s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.390s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-481306269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1209423-4e8a-4260-ad95-b4f64e09e214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d6e8a8ca2748579339b7b4b4fa0c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:22Z,use_quota=True,user_id='54c6cf2c9bab4fefa78777fc38f499f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Creating volume d1209423-4e8a-4260-ad95-b4f64e09e214 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:26 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:32:26 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d1209423-4e8a-4260-ad95-b4f64e09e214 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b67d7606-e097-4503-aeaf-738c2becf22f tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a0e6722c-e028-4595-9ad2-47f944863124" returned: 0 in 0.470s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b67d7606-e097-4503-aeaf-738c2becf22f tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a0e6722c-e028-4595-9ad2-47f944863124 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:26 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d1209423-4e8a-4260-ad95-b4f64e09e214 1073741824 Nov 03 08:32:26 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d97db2fb-e7c2-4f4c-8ff1-7f1adc410104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfb0491f-18a1-4b3a-b5aa-2182d75b7e89', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471e3556-43df-4d54-85d6-531f5e16463c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:26 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a0e6722c-e028-4595-9ad2-47f944863124 Nov 03 08:32:26 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:26 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Volume volume-cfb0491f-18a1-4b3a-b5aa-2182d75b7e89 (cfb0491f-18a1-4b3a-b5aa-2182d75b7e89): created successfully Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471e3556-43df-4d54-85d6-531f5e16463c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Flow 'volume_create_manager' (a58b48a7-7d66-4f81-a60c-2419b3898139) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:26 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-2ba4a38c-3735-4c6e-b919-a14c04ddfc1e tempest-CreateVolumesFromSnapshotTest-494543545 None] Created volume successfully. Nov 03 08:32:26 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_93qsot7u" returned: 1 in 0.391s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_93qsot7u' failed. Not Retrying. {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5e2023-803b-40fd-b5f8-8c528d3d456e]: (4, 'raw') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_hpaltcnkdevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:26 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_hpaltcnkdevstack@QuobyteHD Nov 03 08:32:26 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:26 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b67d7606-e097-4503-aeaf-738c2becf22f tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a0e6722c-e028-4595-9ad2-47f944863124" returned: 0 in 0.303s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b67d7606-e097-4503-aeaf-738c2becf22f tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "cinder-quobyte-a0e6722c-e028-4595-9ad2-47f944863124" released by "delete_volume" :: held 0.827s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-b67d7606-e097-4503-aeaf-738c2becf22f tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Created reservations ['70f5975d-6f99-41ac-84fc-8b5ded55a44f', '95f246a1-a412-4db3-8a7f-befd24ceaa66', '003d0860-6531-4f9d-8b03-01cb1f31581e', 'cb176e74-ed15-40bd-872d-12e1145d3cce'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:32:27 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d1209423-4e8a-4260-ad95-b4f64e09e214 1073741824" returned: 0 in 0.477s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b67d7606-e097-4503-aeaf-738c2becf22f tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b67d7606-e097-4503-aeaf-738c2becf22f tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b67d7606-e097-4503-aeaf-738c2becf22f tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b67d7606-e097-4503-aeaf-738c2becf22f tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:27 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b67d7606-e097-4503-aeaf-738c2becf22f tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b67d7606-e097-4503-aeaf-738c2becf22f tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_hpaltcnkdevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_hpaltcnkdevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:27 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:32:27 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d1209423-4e8a-4260-ad95-b4f64e09e214 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-067b883c-efaf-4ea4-9667-12511def578d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "cinder-8a048870-5f3a-492a-bb26-8163581a7815-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:27 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d1209423-4e8a-4260-ad95-b4f64e09e214 Nov 03 08:32:27 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-067b883c-efaf-4ea4-9667-12511def578d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "cinder-8a048870-5f3a-492a-bb26-8163581a7815-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-067b883c-efaf-4ea4-9667-12511def578d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "cinder-quobyte-8a048870-5f3a-492a-bb26-8163581a7815" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-067b883c-efaf-4ea4-9667-12511def578d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "cinder-quobyte-8a048870-5f3a-492a-bb26-8163581a7815" acquired by "delete_volume" :: waited 0.023s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:27 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_hpaltcnkdevstack@QuobyteHD Nov 03 08:32:27 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedbdcb6-67ae-47e7-87f5-94b6a52791fa]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-067b883c-efaf-4ea4-9667-12511def578d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8a048870-5f3a-492a-bb26-8163581a7815 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:27 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b67d7606-e097-4503-aeaf-738c2becf22f tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.312s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-b67d7606-e097-4503-aeaf-738c2becf22f tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:32:27 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-b67d7606-e097-4503-aeaf-738c2becf22f tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Deleted volume successfully. Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b67d7606-e097-4503-aeaf-738c2becf22f tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "cinder-a0e6722c-e028-4595-9ad2-47f944863124-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:27 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8a048870-5f3a-492a-bb26-8163581a7815 Nov 03 08:32:27 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:27 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d1209423-4e8a-4260-ad95-b4f64e09e214" returned: 0 in 0.375s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.952s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1915869060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c832c0c-d9d8-4c3e-8367-8948f7c5a046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d6e8a8ca2748579339b7b4b4fa0c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:23Z,use_quota=True,user_id='54c6cf2c9bab4fefa78777fc38f499f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Creating volume 3c832c0c-d9d8-4c3e-8367-8948f7c5a046 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:32:27 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3c832c0c-d9d8-4c3e-8367-8948f7c5a046 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:27 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3c832c0c-d9d8-4c3e-8367-8948f7c5a046 1073741824 Nov 03 08:32:27 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b6f810-f22a-4352-b82d-0e7bbcfc06db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1209423-4e8a-4260-ad95-b4f64e09e214', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:27 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (451cd579-92cd-4d28-adcc-c5c582c38bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_hpaltcnkdevstack@QuobyteHD" returned: 1 in 0.483s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_hpaltcnkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] cca0f906-87ab-4f4f-bb41-8fe1e04a9975 was raw, converting to qcow2 {{(pid=86801) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_hpaltcnkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-263fab68-bf71-4e3f-a861-9e041c0d8996 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:27 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Volume volume-d1209423-4e8a-4260-ad95-b4f64e09e214 (d1209423-4e8a-4260-ad95-b4f64e09e214): created successfully Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (451cd579-92cd-4d28-adcc-c5c582c38bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:27 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_hpaltcnkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-263fab68-bf71-4e3f-a861-9e041c0d8996 Nov 03 08:32:27 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Flow 'volume_create_manager' (87f07678-c8da-4197-9bfc-ece8eb1302ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:27 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-66a7dec1-d174-41fc-95f3-6d45a999d5bc tempest-CreateVolumesFromSnapshotTest-494543545 None] Created volume successfully. Nov 03 08:32:27 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-067b883c-efaf-4ea4-9667-12511def578d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8a048870-5f3a-492a-bb26-8163581a7815" returned: 0 in 0.444s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-067b883c-efaf-4ea4-9667-12511def578d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8a048870-5f3a-492a-bb26-8163581a7815 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:27 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8a048870-5f3a-492a-bb26-8163581a7815 Nov 03 08:32:27 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:28 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3c832c0c-d9d8-4c3e-8367-8948f7c5a046 1073741824" returned: 0 in 0.511s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:28 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-067b883c-efaf-4ea4-9667-12511def578d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8a048870-5f3a-492a-bb26-8163581a7815" returned: 0 in 0.328s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3c832c0c-d9d8-4c3e-8367-8948f7c5a046 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:28 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-067b883c-efaf-4ea4-9667-12511def578d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "cinder-quobyte-8a048870-5f3a-492a-bb26-8163581a7815" released by "delete_volume" :: held 0.836s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_hpaltcnkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-263fab68-bf71-4e3f-a861-9e041c0d8996" returned: 0 in 0.531s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cca0f906-87ab-4f4f-bb41-8fe1e04a9975_hpaltcnkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-263fab68-bf71-4e3f-a861-9e041c0d8996 {{(pid=86801) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 08:32:28 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-263fab68-bf71-4e3f-a861-9e041c0d8996 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:28 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3c832c0c-d9d8-4c3e-8367-8948f7c5a046 Nov 03 08:32:28 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:28 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-263fab68-bf71-4e3f-a861-9e041c0d8996 1G Nov 03 08:32:28 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-067b883c-efaf-4ea4-9667-12511def578d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Created reservations ['311177aa-7090-41bd-a8bb-a647beaca025', 'a97c6520-f2f8-442f-a203-39eb3a2a93e5', '46aa6fd6-7048-46d1-a166-6585fb62ca5f', 'f6373cd9-c8ca-4edc-8726-4c8bbff6906b'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-067b883c-efaf-4ea4-9667-12511def578d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-067b883c-efaf-4ea4-9667-12511def578d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-067b883c-efaf-4ea4-9667-12511def578d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-067b883c-efaf-4ea4-9667-12511def578d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-067b883c-efaf-4ea4-9667-12511def578d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-067b883c-efaf-4ea4-9667-12511def578d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:28 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:32:28 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:28 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3c832c0c-d9d8-4c3e-8367-8948f7c5a046" returned: 0 in 0.292s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.429s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1969403959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd6a61b9-f810-49ab-8c5d-8b22622c6add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d6e8a8ca2748579339b7b4b4fa0c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:23Z,use_quota=True,user_id='54c6cf2c9bab4fefa78777fc38f499f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Creating volume fd6a61b9-f810-49ab-8c5d-8b22622c6add {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:32:28 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-fd6a61b9-f810-49ab-8c5d-8b22622c6add 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a659bfb8-ce41-4fbd-9e43-f6803a17a06d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "cinder-df2b0721-3cc9-4478-a98e-8cc34f1d1e0b-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:28 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-fd6a61b9-f810-49ab-8c5d-8b22622c6add 1073741824 Nov 03 08:32:28 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e61da69-316c-4698-bdb9-3142d6169d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c832c0c-d9d8-4c3e-8367-8948f7c5a046', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6c8553-c8af-4989-b9c0-9a05ef62a099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a659bfb8-ce41-4fbd-9e43-f6803a17a06d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "cinder-df2b0721-3cc9-4478-a98e-8cc34f1d1e0b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:28 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Volume volume-3c832c0c-d9d8-4c3e-8367-8948f7c5a046 (3c832c0c-d9d8-4c3e-8367-8948f7c5a046): created successfully Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6c8553-c8af-4989-b9c0-9a05ef62a099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Flow 'volume_create_manager' (f6f9a362-3051-4db3-8ce0-83402792f68c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:28 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-68e97065-11e5-494c-8deb-374cfa736264 tempest-CreateVolumesFromSnapshotTest-494543545 None] Created volume successfully. Nov 03 08:32:28 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a659bfb8-ce41-4fbd-9e43-f6803a17a06d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "cinder-quobyte-df2b0721-3cc9-4478-a98e-8cc34f1d1e0b" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-263fab68-bf71-4e3f-a861-9e041c0d8996 1G" returned: 0 in 0.442s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Downloaded image cca0f906-87ab-4f4f-bb41-8fe1e04a9975 ((None, [{'url': 'file:///opt/stack/data/glance/images/cca0f906-87ab-4f4f-bb41-8fe1e04a9975', 'metadata': {}}])) to volume 263fab68-bf71-4e3f-a861-9e041c0d8996 successfully. {{(pid=86801) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Temporary image cca0f906-87ab-4f4f-bb41-8fe1e04a9975 for user bc583d59422b43c09b0de4835538a3e0 is deleted. {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Marking volume 263fab68-bf71-4e3f-a861-9e041c0d8996 as bootable. {{(pid=86801) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a659bfb8-ce41-4fbd-9e43-f6803a17a06d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "cinder-quobyte-df2b0721-3cc9-4478-a98e-8cc34f1d1e0b" acquired by "delete_volume" :: waited 0.024s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Copying metadata from image cca0f906-87ab-4f4f-bb41-8fe1e04a9975 to 263fab68-bf71-4e3f-a861-9e041c0d8996. {{(pid=86801) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Creating volume glance metadata for volume 263fab68-bf71-4e3f-a861-9e041c0d8996 backed by image cca0f906-87ab-4f4f-bb41-8fe1e04a9975 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'cca0f906-87ab-4f4f-bb41-8fe1e04a9975', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3124657360655c5aca01fa3777aa9feb', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86801) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e69f9e-164b-4778-9435-3b241f65c21a]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a659bfb8-ce41-4fbd-9e43-f6803a17a06d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-df2b0721-3cc9-4478-a98e-8cc34f1d1e0b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:28 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-067b883c-efaf-4ea4-9667-12511def578d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.399s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-067b883c-efaf-4ea4-9667-12511def578d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:32:28 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-067b883c-efaf-4ea4-9667-12511def578d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Deleted volume successfully. Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-067b883c-efaf-4ea4-9667-12511def578d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "cinder-8a048870-5f3a-492a-bb26-8163581a7815-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f221f2d0-a471-4623-9f8d-855c0835a19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-263fab68-bf71-4e3f-a861-9e041c0d8996', 'volume_size': 1, 'image_id': 'cca0f906-87ab-4f4f-bb41-8fe1e04a9975', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cca0f906-87ab-4f4f-bb41-8fe1e04a9975', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3124657360655c5aca01fa3777aa9feb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c175eb77c8c74e00b65ef1a449392a72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '04046511fe7d248edee8fa30c039c3f94c8598ee4142e4c3eeb63bea0e9abe0d0c4a565c24d2d55e1b7c328f446db9a8bb6addc019bc965b99c4df9bfe6dcc35', 'id': 'cca0f906-87ab-4f4f-bb41-8fe1e04a9975', 'created_at': datetime.datetime(2026, 11, 3, 7, 32, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 32, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cca0f906-87ab-4f4f-bb41-8fe1e04a9975/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2964e6b2-584a-49da-af2c-9dd6901a0bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:28 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Volume volume-263fab68-bf71-4e3f-a861-9e041c0d8996 (263fab68-bf71-4e3f-a861-9e041c0d8996): created successfully Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2964e6b2-584a-49da-af2c-9dd6901a0bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:28 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Flow 'volume_create_manager' (458172e5-9f57-4067-be27-cb370d026d21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:28 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-8026a480-60e6-4e26-bf89-defa989d6e0f tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Created volume successfully. Nov 03 08:32:28 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-df2b0721-3cc9-4478-a98e-8cc34f1d1e0b Nov 03 08:32:28 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:29 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-fd6a61b9-f810-49ab-8c5d-8b22622c6add 1073741824" returned: 0 in 0.578s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-fd6a61b9-f810-49ab-8c5d-8b22622c6add {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:29 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-fd6a61b9-f810-49ab-8c5d-8b22622c6add Nov 03 08:32:29 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-89061e05-6b81-4496-8a68-30c98bdd565d tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Acquiring lock "cinder-263fab68-bf71-4e3f-a861-9e041c0d8996-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-89061e05-6b81-4496-8a68-30c98bdd565d tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Lock "cinder-263fab68-bf71-4e3f-a861-9e041c0d8996-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:29 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a659bfb8-ce41-4fbd-9e43-f6803a17a06d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-df2b0721-3cc9-4478-a98e-8cc34f1d1e0b" returned: 0 in 0.517s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a659bfb8-ce41-4fbd-9e43-f6803a17a06d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-df2b0721-3cc9-4478-a98e-8cc34f1d1e0b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:29 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-df2b0721-3cc9-4478-a98e-8cc34f1d1e0b Nov 03 08:32:29 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-89061e05-6b81-4496-8a68-30c98bdd565d tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Acquiring lock "cinder-quobyte-263fab68-bf71-4e3f-a861-9e041c0d8996" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-89061e05-6b81-4496-8a68-30c98bdd565d tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Lock "cinder-quobyte-263fab68-bf71-4e3f-a861-9e041c0d8996" acquired by "delete_volume" :: waited 0.016s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ec8857-6cee-43b6-b35a-a68d57a89d88]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-89061e05-6b81-4496-8a68-30c98bdd565d tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-263fab68-bf71-4e3f-a861-9e041c0d8996 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:29 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-fd6a61b9-f810-49ab-8c5d-8b22622c6add" returned: 0 in 0.307s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.996s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-368845358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64cd0555-5dda-4863-9bf4-56ec5487236e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d6e8a8ca2748579339b7b4b4fa0c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:23Z,use_quota=True,user_id='54c6cf2c9bab4fefa78777fc38f499f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Creating volume 64cd0555-5dda-4863-9bf4-56ec5487236e {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:32:29 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-64cd0555-5dda-4863-9bf4-56ec5487236e 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:29 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-263fab68-bf71-4e3f-a861-9e041c0d8996 Nov 03 08:32:29 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e40e9fc-366c-4974-a9dd-2f8c6ae07c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd6a61b9-f810-49ab-8c5d-8b22622c6add', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:29 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-64cd0555-5dda-4863-9bf4-56ec5487236e 1073741824 Nov 03 08:32:29 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa76130-b5a6-4ae4-9858-f2c52d154752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:29 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Volume volume-fd6a61b9-f810-49ab-8c5d-8b22622c6add (fd6a61b9-f810-49ab-8c5d-8b22622c6add): created successfully Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa76130-b5a6-4ae4-9858-f2c52d154752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Flow 'volume_create_manager' (1a3c2bc2-ecda-46ac-8e98-5faa190a6863) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:29 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-be51c1cf-f97e-4d10-a296-6c5993d5cc09 tempest-CreateVolumesFromSnapshotTest-494543545 None] Created volume successfully. Nov 03 08:32:29 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a659bfb8-ce41-4fbd-9e43-f6803a17a06d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-df2b0721-3cc9-4478-a98e-8cc34f1d1e0b" returned: 0 in 0.315s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a659bfb8-ce41-4fbd-9e43-f6803a17a06d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "cinder-quobyte-df2b0721-3cc9-4478-a98e-8cc34f1d1e0b" released by "delete_volume" :: held 0.898s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-a659bfb8-ce41-4fbd-9e43-f6803a17a06d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Created reservations ['614d30bf-5f80-41b1-8275-616d3bc79c87', '31d82197-3c03-4117-af8e-13a78345de06', '4e36d0f6-afd1-4a48-916a-29f0d339d806', 'ee9ec617-4c44-4d04-9e1d-e5c59c475b2f'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a659bfb8-ce41-4fbd-9e43-f6803a17a06d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a659bfb8-ce41-4fbd-9e43-f6803a17a06d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a659bfb8-ce41-4fbd-9e43-f6803a17a06d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a659bfb8-ce41-4fbd-9e43-f6803a17a06d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a659bfb8-ce41-4fbd-9e43-f6803a17a06d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a659bfb8-ce41-4fbd-9e43-f6803a17a06d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:29 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:32:29 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:29 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-89061e05-6b81-4496-8a68-30c98bdd565d tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-263fab68-bf71-4e3f-a861-9e041c0d8996" returned: 0 in 0.424s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-89061e05-6b81-4496-8a68-30c98bdd565d tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-263fab68-bf71-4e3f-a861-9e041c0d8996 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:29 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-263fab68-bf71-4e3f-a861-9e041c0d8996 Nov 03 08:32:29 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:30 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-64cd0555-5dda-4863-9bf4-56ec5487236e 1073741824" returned: 0 in 0.525s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:30 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a659bfb8-ce41-4fbd-9e43-f6803a17a06d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.289s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-a659bfb8-ce41-4fbd-9e43-f6803a17a06d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:32:30 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-a659bfb8-ce41-4fbd-9e43-f6803a17a06d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Deleted volume successfully. Nov 03 08:32:30 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-64cd0555-5dda-4863-9bf4-56ec5487236e {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a659bfb8-ce41-4fbd-9e43-f6803a17a06d tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "cinder-df2b0721-3cc9-4478-a98e-8cc34f1d1e0b-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-89061e05-6b81-4496-8a68-30c98bdd565d tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-263fab68-bf71-4e3f-a861-9e041c0d8996" returned: 0 in 0.338s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:30 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-64cd0555-5dda-4863-9bf4-56ec5487236e Nov 03 08:32:30 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-89061e05-6b81-4496-8a68-30c98bdd565d tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Lock "cinder-quobyte-263fab68-bf71-4e3f-a861-9e041c0d8996" released by "delete_volume" :: held 0.833s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-89061e05-6b81-4496-8a68-30c98bdd565d tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Created reservations ['543c9d46-d331-408a-ab8e-df417f4ceae9', 'da7fece5-aa58-459b-a315-8aad26a0a9e5', '754aa34c-9081-41de-93d8-daf2fd8e702e', 'effc7db4-8dc6-4d0d-b444-6e3296930de5'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-89061e05-6b81-4496-8a68-30c98bdd565d tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-89061e05-6b81-4496-8a68-30c98bdd565d tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-89061e05-6b81-4496-8a68-30c98bdd565d tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-89061e05-6b81-4496-8a68-30c98bdd565d tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-89061e05-6b81-4496-8a68-30c98bdd565d tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-89061e05-6b81-4496-8a68-30c98bdd565d tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:30 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:32:30 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:30 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-64cd0555-5dda-4863-9bf4-56ec5487236e" returned: 0 in 0.303s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3afd4c38-c83a-4ef2-a3f9-85546c355885 tempest-CinderUnicodeTest-1776522857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.282s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352397b3-a59f-4313-92c8-9057cdafc509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64cd0555-5dda-4863-9bf4-56ec5487236e', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd57fa52-b3aa-4081-8e6e-331a42fa6a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-3afd4c38-c83a-4ef2-a3f9-85546c355885 tempest-CinderUnicodeTest-1776522857 None] Creating offline snapshot bb599603-c061-41df-84b0-2049c93a2b57 of volume 9b544be6-f501-40dc-9608-d8c54cd60d16 {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:32:30 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Volume volume-64cd0555-5dda-4863-9bf4-56ec5487236e (64cd0555-5dda-4863-9bf4-56ec5487236e): created successfully Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd57fa52-b3aa-4081-8e6e-331a42fa6a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Flow 'volume_create_manager' (5435b1fb-18eb-4382-8bb7-fad4d747ad21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4565d2b-f1d3-4144-9975-190cdd293d29]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3afd4c38-c83a-4ef2-a3f9-85546c355885 tempest-CinderUnicodeTest-1776522857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:30 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-14bedcf9-06cb-49a0-a100-b0a3abd9b217 tempest-CreateVolumesFromSnapshotTest-494543545 None] Created volume successfully. Nov 03 08:32:30 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-89061e05-6b81-4496-8a68-30c98bdd565d tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.273s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-89061e05-6b81-4496-8a68-30c98bdd565d tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:32:30 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-89061e05-6b81-4496-8a68-30c98bdd565d tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Deleted volume successfully. Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-89061e05-6b81-4496-8a68-30c98bdd565d tempest-VolumeAndVolumeTypeFromImageTest-2042363776 None] Lock "cinder-263fab68-bf71-4e3f-a861-9e041c0d8996-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:30 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16 Nov 03 08:32:30 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0f27f26a-3cd6-418e-8e9f-46f7e281c40c tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "cinder-dbc8bcfe-fe01-4d44-855b-67b73c760d70-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0f27f26a-3cd6-418e-8e9f-46f7e281c40c tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "cinder-dbc8bcfe-fe01-4d44-855b-67b73c760d70-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0f27f26a-3cd6-418e-8e9f-46f7e281c40c tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "cinder-quobyte-dbc8bcfe-fe01-4d44-855b-67b73c760d70" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0f27f26a-3cd6-418e-8e9f-46f7e281c40c tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "cinder-quobyte-dbc8bcfe-fe01-4d44-855b-67b73c760d70" acquired by "delete_volume" :: waited 0.016s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[e345f33b-a39d-4e05-8c2f-2626f94067bc]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0f27f26a-3cd6-418e-8e9f-46f7e281c40c tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-dbc8bcfe-fe01-4d44-855b-67b73c760d70 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:30 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3afd4c38-c83a-4ef2-a3f9-85546c355885 tempest-CinderUnicodeTest-1776522857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16" returned: 0 in 0.437s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3afd4c38-c83a-4ef2-a3f9-85546c355885 tempest-CinderUnicodeTest-1776522857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16.bb599603-c061-41df-84b0-2049c93a2b57 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:30 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16.bb599603-c061-41df-84b0-2049c93a2b57 1G Nov 03 08:32:30 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:31 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-dbc8bcfe-fe01-4d44-855b-67b73c760d70 Nov 03 08:32:31 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:31 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1e67d737-bbc7-418e-b107-4425ad62bb88 tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "cinder-64cd0555-5dda-4863-9bf4-56ec5487236e-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:31 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1e67d737-bbc7-418e-b107-4425ad62bb88 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-64cd0555-5dda-4863-9bf4-56ec5487236e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:31 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1e67d737-bbc7-418e-b107-4425ad62bb88 tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "cinder-quobyte-64cd0555-5dda-4863-9bf4-56ec5487236e" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:31 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1e67d737-bbc7-418e-b107-4425ad62bb88 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-quobyte-64cd0555-5dda-4863-9bf4-56ec5487236e" acquired by "delete_volume" :: waited 0.020s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:31 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[86caef9a-25f7-42bb-bc51-837f08e3cd70]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1e67d737-bbc7-418e-b107-4425ad62bb88 tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-64cd0555-5dda-4863-9bf4-56ec5487236e {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:31 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0f27f26a-3cd6-418e-8e9f-46f7e281c40c tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-dbc8bcfe-fe01-4d44-855b-67b73c760d70" returned: 0 in 0.524s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0f27f26a-3cd6-418e-8e9f-46f7e281c40c tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-dbc8bcfe-fe01-4d44-855b-67b73c760d70 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:31 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:31 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-64cd0555-5dda-4863-9bf4-56ec5487236e Nov 03 08:32:31 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3afd4c38-c83a-4ef2-a3f9-85546c355885 tempest-CinderUnicodeTest-1776522857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16.bb599603-c061-41df-84b0-2049c93a2b57 1G" returned: 0 in 0.517s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3afd4c38-c83a-4ef2-a3f9-85546c355885 tempest-CinderUnicodeTest-1776522857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b544be6-f501-40dc-9608-d8c54cd60d16 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16.bb599603-c061-41df-84b0-2049c93a2b57 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:31 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-dbc8bcfe-fe01-4d44-855b-67b73c760d70 Nov 03 08:32:31 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:31 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b544be6-f501-40dc-9608-d8c54cd60d16 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16.bb599603-c061-41df-84b0-2049c93a2b57 Nov 03 08:32:31 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:31 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0f27f26a-3cd6-418e-8e9f-46f7e281c40c tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-dbc8bcfe-fe01-4d44-855b-67b73c760d70" returned: 0 in 0.267s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:31 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0f27f26a-3cd6-418e-8e9f-46f7e281c40c tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "cinder-quobyte-dbc8bcfe-fe01-4d44-855b-67b73c760d70" released by "delete_volume" :: held 0.843s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:31 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1e67d737-bbc7-418e-b107-4425ad62bb88 tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-64cd0555-5dda-4863-9bf4-56ec5487236e" returned: 0 in 0.430s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1e67d737-bbc7-418e-b107-4425ad62bb88 tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-64cd0555-5dda-4863-9bf4-56ec5487236e {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:31 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-64cd0555-5dda-4863-9bf4-56ec5487236e Nov 03 08:32:31 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:31 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-0f27f26a-3cd6-418e-8e9f-46f7e281c40c tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Created reservations ['7b961587-fbdd-4938-bc93-d014acad5b7e', 'c14cf25f-d0f1-43fd-a7db-31341e87b7be', '47818477-7409-45fb-b871-3726145e2861', 'aeaa532a-2ff5-444d-9195-9c3009d5a07c'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:32:31 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3afd4c38-c83a-4ef2-a3f9-85546c355885 tempest-CinderUnicodeTest-1776522857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b544be6-f501-40dc-9608-d8c54cd60d16 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16.bb599603-c061-41df-84b0-2049c93a2b57" returned: 0 in 0.419s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:31 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-3afd4c38-c83a-4ef2-a3f9-85546c355885 tempest-CinderUnicodeTest-1776522857 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16.bb599603-c061-41df-84b0-2049c93a2b57 is being set with open permissions: ugo+rw Nov 03 08:32:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3afd4c38-c83a-4ef2-a3f9-85546c355885 tempest-CinderUnicodeTest-1776522857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16.bb599603-c061-41df-84b0-2049c93a2b57 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0f27f26a-3cd6-418e-8e9f-46f7e281c40c tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0f27f26a-3cd6-418e-8e9f-46f7e281c40c tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0f27f26a-3cd6-418e-8e9f-46f7e281c40c tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:31 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16.bb599603-c061-41df-84b0-2049c93a2b57 Nov 03 08:32:31 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-0f27f26a-3cd6-418e-8e9f-46f7e281c40c tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0f27f26a-3cd6-418e-8e9f-46f7e281c40c tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0f27f26a-3cd6-418e-8e9f-46f7e281c40c tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:32 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:32:32 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:32 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f3e76bc5-72d9-40dc-971e-e9db406b58f1 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "cinder-601d2c49-10fb-4a98-8191-7bed9cca8ce8-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:32 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f3e76bc5-72d9-40dc-971e-e9db406b58f1 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "cinder-601d2c49-10fb-4a98-8191-7bed9cca8ce8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:32 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f3e76bc5-72d9-40dc-971e-e9db406b58f1 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "cinder-quobyte-601d2c49-10fb-4a98-8191-7bed9cca8ce8" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:32 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:32 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f3e76bc5-72d9-40dc-971e-e9db406b58f1 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "cinder-quobyte-601d2c49-10fb-4a98-8191-7bed9cca8ce8" acquired by "delete_volume" :: waited 0.031s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1e67d737-bbc7-418e-b107-4425ad62bb88 tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-64cd0555-5dda-4863-9bf4-56ec5487236e" returned: 0 in 0.502s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:32 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1e67d737-bbc7-418e-b107-4425ad62bb88 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-quobyte-64cd0555-5dda-4863-9bf4-56ec5487236e" released by "delete_volume" :: held 1.001s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:32 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df22845-65a8-494c-afed-2f2bba21a680]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f3e76bc5-72d9-40dc-971e-e9db406b58f1 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-601d2c49-10fb-4a98-8191-7bed9cca8ce8 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:32 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3afd4c38-c83a-4ef2-a3f9-85546c355885 tempest-CinderUnicodeTest-1776522857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16.bb599603-c061-41df-84b0-2049c93a2b57" returned: 0 in 0.473s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3afd4c38-c83a-4ef2-a3f9-85546c355885 tempest-CinderUnicodeTest-1776522857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:32 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-1e67d737-bbc7-418e-b107-4425ad62bb88 tempest-CreateVolumesFromSnapshotTest-494543545 None] Created reservations ['a9c909c8-2bb3-4416-8cb8-762f215fcbe3', 'cff04d57-7ec4-4cfa-9828-8a025e49dd0e', '34931a32-cb49-4861-bdb2-c78142a3ed96', 'c44fa65b-151f-4c30-a2a1-432f95fee425'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:32:32 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-601d2c49-10fb-4a98-8191-7bed9cca8ce8 Nov 03 08:32:32 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:32 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:32 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16.info Nov 03 08:32:32 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0f27f26a-3cd6-418e-8e9f-46f7e281c40c tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.555s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:32 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-0f27f26a-3cd6-418e-8e9f-46f7e281c40c tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:32:32 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-0f27f26a-3cd6-418e-8e9f-46f7e281c40c tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Deleted volume successfully. Nov 03 08:32:32 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0f27f26a-3cd6-418e-8e9f-46f7e281c40c tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "cinder-dbc8bcfe-fe01-4d44-855b-67b73c760d70-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1e67d737-bbc7-418e-b107-4425ad62bb88 tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1e67d737-bbc7-418e-b107-4425ad62bb88 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:32 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1e67d737-bbc7-418e-b107-4425ad62bb88 tempest-CreateVolumesFromSnapshotTest-494543545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:32 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1e67d737-bbc7-418e-b107-4425ad62bb88 tempest-CreateVolumesFromSnapshotTest-494543545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1e67d737-bbc7-418e-b107-4425ad62bb88 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1e67d737-bbc7-418e-b107-4425ad62bb88 tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:32 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:32:32 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:32 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3afd4c38-c83a-4ef2-a3f9-85546c355885 tempest-CinderUnicodeTest-1776522857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16.info" returned: 0 in 0.386s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:32 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-3afd4c38-c83a-4ef2-a3f9-85546c355885 tempest-CinderUnicodeTest-1776522857 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16.info is being set with open permissions: ugo+rw Nov 03 08:32:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3afd4c38-c83a-4ef2-a3f9-85546c355885 tempest-CinderUnicodeTest-1776522857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:32 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f3e76bc5-72d9-40dc-971e-e9db406b58f1 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-601d2c49-10fb-4a98-8191-7bed9cca8ce8" returned: 0 in 0.549s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f3e76bc5-72d9-40dc-971e-e9db406b58f1 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-601d2c49-10fb-4a98-8191-7bed9cca8ce8 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:32 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16.info Nov 03 08:32:32 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:32 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-601d2c49-10fb-4a98-8191-7bed9cca8ce8 Nov 03 08:32:32 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:32 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1e67d737-bbc7-418e-b107-4425ad62bb88 tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.327s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-1e67d737-bbc7-418e-b107-4425ad62bb88 tempest-CreateVolumesFromSnapshotTest-494543545 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:32:33 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-1e67d737-bbc7-418e-b107-4425ad62bb88 tempest-CreateVolumesFromSnapshotTest-494543545 None] Deleted volume successfully. Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1e67d737-bbc7-418e-b107-4425ad62bb88 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-64cd0555-5dda-4863-9bf4-56ec5487236e-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:33 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3afd4c38-c83a-4ef2-a3f9-85546c355885 tempest-CinderUnicodeTest-1776522857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16.info" returned: 0 in 0.328s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:33 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3afd4c38-c83a-4ef2-a3f9-85546c355885 tempest-CinderUnicodeTest-1776522857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.767s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f3e76bc5-72d9-40dc-971e-e9db406b58f1 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-601d2c49-10fb-4a98-8191-7bed9cca8ce8" returned: 0 in 0.361s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f3e76bc5-72d9-40dc-971e-e9db406b58f1 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "cinder-quobyte-601d2c49-10fb-4a98-8191-7bed9cca8ce8" released by "delete_volume" :: held 0.995s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:33 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-3afd4c38-c83a-4ef2-a3f9-85546c355885 tempest-CinderUnicodeTest-1776522857 None] Create snapshot completed successfully Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-f3e76bc5-72d9-40dc-971e-e9db406b58f1 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Created reservations ['64c6633d-21e1-4e46-a7f6-416b64492b44', '1b4869bb-706a-44a3-ba5e-c6be67baed0d', '4c9885aa-cfd8-4f81-8c17-f622933a232a', '57557947-ed8b-412e-815b-2ba2f987537d'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f3e76bc5-72d9-40dc-971e-e9db406b58f1 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f3e76bc5-72d9-40dc-971e-e9db406b58f1 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f3e76bc5-72d9-40dc-971e-e9db406b58f1 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f3e76bc5-72d9-40dc-971e-e9db406b58f1 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f3e76bc5-72d9-40dc-971e-e9db406b58f1 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f3e76bc5-72d9-40dc-971e-e9db406b58f1 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:33 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:32:33 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9325aa5c-2268-4837-bc6e-ea2bfdff667b tempest-CinderUnicodeTest-1776522857 None] Acquiring lock "cinder-bb599603-c061-41df-84b0-2049c93a2b57-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-fed25c47-839b-46ff-a0ac-eedb876e3758 tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "cinder-fd6a61b9-f810-49ab-8c5d-8b22622c6add-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9325aa5c-2268-4837-bc6e-ea2bfdff667b tempest-CinderUnicodeTest-1776522857 None] Lock "cinder-bb599603-c061-41df-84b0-2049c93a2b57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9325aa5c-2268-4837-bc6e-ea2bfdff667b tempest-CinderUnicodeTest-1776522857 None] Acquiring lock "cinder-quobyte-9b544be6-f501-40dc-9608-d8c54cd60d16" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-fed25c47-839b-46ff-a0ac-eedb876e3758 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-fd6a61b9-f810-49ab-8c5d-8b22622c6add-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9325aa5c-2268-4837-bc6e-ea2bfdff667b tempest-CinderUnicodeTest-1776522857 None] Lock "cinder-quobyte-9b544be6-f501-40dc-9608-d8c54cd60d16" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9325aa5c-2268-4837-bc6e-ea2bfdff667b tempest-CinderUnicodeTest-1776522857 None] Acquiring lock "cinder-quobyte-bb599603-c061-41df-84b0-2049c93a2b57" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9325aa5c-2268-4837-bc6e-ea2bfdff667b tempest-CinderUnicodeTest-1776522857 None] Lock "cinder-quobyte-bb599603-c061-41df-84b0-2049c93a2b57" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-9325aa5c-2268-4837-bc6e-ea2bfdff667b tempest-CinderUnicodeTest-1776522857 None] Deleting offline snapshot bb599603-c061-41df-84b0-2049c93a2b57 of volume 9b544be6-f501-40dc-9608-d8c54cd60d16 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-9325aa5c-2268-4837-bc6e-ea2bfdff667b tempest-CinderUnicodeTest-1776522857 None] snapshot_file for this snap is: volume-9b544be6-f501-40dc-9608-d8c54cd60d16.bb599603-c061-41df-84b0-2049c93a2b57 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-fed25c47-839b-46ff-a0ac-eedb876e3758 tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "cinder-quobyte-fd6a61b9-f810-49ab-8c5d-8b22622c6add" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c77efcc-4f52-4bcd-a6a8-aca243242383]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9325aa5c-2268-4837-bc6e-ea2bfdff667b tempest-CinderUnicodeTest-1776522857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16.bb599603-c061-41df-84b0-2049c93a2b57 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-fed25c47-839b-46ff-a0ac-eedb876e3758 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-quobyte-fd6a61b9-f810-49ab-8c5d-8b22622c6add" acquired by "delete_volume" :: waited 0.028s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42e8ebd-1505-4484-821f-db0e03e3b5a7]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fed25c47-839b-46ff-a0ac-eedb876e3758 tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-fd6a61b9-f810-49ab-8c5d-8b22622c6add {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:33 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f3e76bc5-72d9-40dc-971e-e9db406b58f1 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.361s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-f3e76bc5-72d9-40dc-971e-e9db406b58f1 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:32:33 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-f3e76bc5-72d9-40dc-971e-e9db406b58f1 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Deleted volume successfully. Nov 03 08:32:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f3e76bc5-72d9-40dc-971e-e9db406b58f1 tempest-CreateVolumesFromSourceVolumeTest-1060452013 None] Lock "cinder-601d2c49-10fb-4a98-8191-7bed9cca8ce8-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:33 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16.bb599603-c061-41df-84b0-2049c93a2b57 Nov 03 08:32:33 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:33 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-fd6a61b9-f810-49ab-8c5d-8b22622c6add Nov 03 08:32:33 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:34 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9325aa5c-2268-4837-bc6e-ea2bfdff667b tempest-CinderUnicodeTest-1776522857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16.bb599603-c061-41df-84b0-2049c93a2b57" returned: 0 in 0.436s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:34 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-9325aa5c-2268-4837-bc6e-ea2bfdff667b tempest-CinderUnicodeTest-1776522857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b544be6-f501-40dc-9608-d8c54cd60d16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:32:34 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fed25c47-839b-46ff-a0ac-eedb876e3758 tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-fd6a61b9-f810-49ab-8c5d-8b22622c6add" returned: 0 in 0.423s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fed25c47-839b-46ff-a0ac-eedb876e3758 tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-fd6a61b9-f810-49ab-8c5d-8b22622c6add {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:34 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[f449a7e8-fc1b-42d9-b26a-3c9d39e9e37b]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9325aa5c-2268-4837-bc6e-ea2bfdff667b tempest-CinderUnicodeTest-1776522857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:34 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-fd6a61b9-f810-49ab-8c5d-8b22622c6add Nov 03 08:32:34 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:34 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16 Nov 03 08:32:34 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:34 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fed25c47-839b-46ff-a0ac-eedb876e3758 tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-fd6a61b9-f810-49ab-8c5d-8b22622c6add" returned: 0 in 0.301s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-fed25c47-839b-46ff-a0ac-eedb876e3758 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-quobyte-fd6a61b9-f810-49ab-8c5d-8b22622c6add" released by "delete_volume" :: held 0.784s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:34 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-fed25c47-839b-46ff-a0ac-eedb876e3758 tempest-CreateVolumesFromSnapshotTest-494543545 None] Created reservations ['5669b473-9351-4226-ac14-a07667c0f588', '95c2c129-ab27-4f47-b5a0-14a44d9cb199', '233ba581-548c-458e-9f23-14fca5da51d2', 'd6fb7a89-3cd3-4f5f-b8b0-fd08d8deb684'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:32:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fed25c47-839b-46ff-a0ac-eedb876e3758 tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fed25c47-839b-46ff-a0ac-eedb876e3758 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:34 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fed25c47-839b-46ff-a0ac-eedb876e3758 tempest-CreateVolumesFromSnapshotTest-494543545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:34 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-fed25c47-839b-46ff-a0ac-eedb876e3758 tempest-CreateVolumesFromSnapshotTest-494543545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-fed25c47-839b-46ff-a0ac-eedb876e3758 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fed25c47-839b-46ff-a0ac-eedb876e3758 tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:34 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9325aa5c-2268-4837-bc6e-ea2bfdff667b tempest-CinderUnicodeTest-1776522857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16" returned: 0 in 0.479s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9325aa5c-2268-4837-bc6e-ea2bfdff667b tempest-CinderUnicodeTest-1776522857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16.bb599603-c061-41df-84b0-2049c93a2b57 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:34 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:32:34 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:34 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16.bb599603-c061-41df-84b0-2049c93a2b57 Nov 03 08:32:34 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-759fa4e3-dec0-4e04-894b-495b0587e862 tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "cinder-3c832c0c-d9d8-4c3e-8367-8948f7c5a046-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-759fa4e3-dec0-4e04-894b-495b0587e862 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-3c832c0c-d9d8-4c3e-8367-8948f7c5a046-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-759fa4e3-dec0-4e04-894b-495b0587e862 tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "cinder-quobyte-3c832c0c-d9d8-4c3e-8367-8948f7c5a046" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-759fa4e3-dec0-4e04-894b-495b0587e862 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-quobyte-3c832c0c-d9d8-4c3e-8367-8948f7c5a046" acquired by "delete_volume" :: waited 0.030s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:34 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[9debe829-b12f-49a3-b710-cc32f6582580]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-759fa4e3-dec0-4e04-894b-495b0587e862 tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3c832c0c-d9d8-4c3e-8367-8948f7c5a046 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:35 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-fed25c47-839b-46ff-a0ac-eedb876e3758 tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.419s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:35 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-fed25c47-839b-46ff-a0ac-eedb876e3758 tempest-CreateVolumesFromSnapshotTest-494543545 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:32:35 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-fed25c47-839b-46ff-a0ac-eedb876e3758 tempest-CreateVolumesFromSnapshotTest-494543545 None] Deleted volume successfully. Nov 03 08:32:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-fed25c47-839b-46ff-a0ac-eedb876e3758 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-fd6a61b9-f810-49ab-8c5d-8b22622c6add-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:35 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3c832c0c-d9d8-4c3e-8367-8948f7c5a046 Nov 03 08:32:35 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:35 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9325aa5c-2268-4837-bc6e-ea2bfdff667b tempest-CinderUnicodeTest-1776522857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16.bb599603-c061-41df-84b0-2049c93a2b57" returned: 0 in 0.614s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9325aa5c-2268-4837-bc6e-ea2bfdff667b tempest-CinderUnicodeTest-1776522857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16.bb599603-c061-41df-84b0-2049c93a2b57 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:35 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16.bb599603-c061-41df-84b0-2049c93a2b57 Nov 03 08:32:35 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:35 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-759fa4e3-dec0-4e04-894b-495b0587e862 tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3c832c0c-d9d8-4c3e-8367-8948f7c5a046" returned: 0 in 0.545s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-759fa4e3-dec0-4e04-894b-495b0587e862 tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3c832c0c-d9d8-4c3e-8367-8948f7c5a046 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:35 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3c832c0c-d9d8-4c3e-8367-8948f7c5a046 Nov 03 08:32:35 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:35 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-9325aa5c-2268-4837-bc6e-ea2bfdff667b tempest-CinderUnicodeTest-1776522857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16.bb599603-c061-41df-84b0-2049c93a2b57" returned: 0 in 0.335s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9325aa5c-2268-4837-bc6e-ea2bfdff667b tempest-CinderUnicodeTest-1776522857 None] Lock "cinder-quobyte-bb599603-c061-41df-84b0-2049c93a2b57" released by "_delete_snapshot" :: held 2.035s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9325aa5c-2268-4837-bc6e-ea2bfdff667b tempest-CinderUnicodeTest-1776522857 None] Lock "cinder-quobyte-9b544be6-f501-40dc-9608-d8c54cd60d16" released by "delete_snapshot" :: held 2.082s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:35 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-9325aa5c-2268-4837-bc6e-ea2bfdff667b tempest-CinderUnicodeTest-1776522857 None] Created reservations ['39e68355-9e86-416b-8e34-4066d431428d', 'bdac37ef-612f-4ff8-86fd-19e447a91093', 'b2c5dcf5-0188-482d-b6cc-641a9c17a1f6', '49343ce2-f6ac-4704-b543-f9393525afef'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:32:35 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-759fa4e3-dec0-4e04-894b-495b0587e862 tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3c832c0c-d9d8-4c3e-8367-8948f7c5a046" returned: 0 in 0.322s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:35 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-9325aa5c-2268-4837-bc6e-ea2bfdff667b tempest-CinderUnicodeTest-1776522857 None] Delete snapshot completed successfully. Nov 03 08:32:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-759fa4e3-dec0-4e04-894b-495b0587e862 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-quobyte-3c832c0c-d9d8-4c3e-8367-8948f7c5a046" released by "delete_volume" :: held 0.924s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-9325aa5c-2268-4837-bc6e-ea2bfdff667b tempest-CinderUnicodeTest-1776522857 None] Lock "cinder-bb599603-c061-41df-84b0-2049c93a2b57-delete_snapshot" released by "delete_snapshot" :: held 2.295s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:35 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-759fa4e3-dec0-4e04-894b-495b0587e862 tempest-CreateVolumesFromSnapshotTest-494543545 None] Created reservations ['8edac8ac-8912-48c3-a036-7ad23a918762', 'c2801861-8409-4395-8b27-97360e60edaa', '423a331a-43d3-4ff2-baf4-6f7f8e497570', 'd516c3d8-c15a-43bf-b7ac-e4e59fbd4471'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-759fa4e3-dec0-4e04-894b-495b0587e862 tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-759fa4e3-dec0-4e04-894b-495b0587e862 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-759fa4e3-dec0-4e04-894b-495b0587e862 tempest-CreateVolumesFromSnapshotTest-494543545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-759fa4e3-dec0-4e04-894b-495b0587e862 tempest-CreateVolumesFromSnapshotTest-494543545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-759fa4e3-dec0-4e04-894b-495b0587e862 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-759fa4e3-dec0-4e04-894b-495b0587e862 tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:36 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:32:36 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:36 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-759fa4e3-dec0-4e04-894b-495b0587e862 tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.317s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-759fa4e3-dec0-4e04-894b-495b0587e862 tempest-CreateVolumesFromSnapshotTest-494543545 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:32:36 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-759fa4e3-dec0-4e04-894b-495b0587e862 tempest-CreateVolumesFromSnapshotTest-494543545 None] Deleted volume successfully. Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-759fa4e3-dec0-4e04-894b-495b0587e862 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-3c832c0c-d9d8-4c3e-8367-8948f7c5a046-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Flow 'volume_create_manager' (6699b256-1ed2-49c0-85c3-15e8ff0360fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd547fff-7bd5-4222-badd-e2113c61d7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd547fff-7bd5-4222-badd-e2113c61d7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-362562568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab901d7-4824-4809-a683-8a3525a31dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef688ecdcef941b188e5d420472adc61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:36Z,use_quota=True,user_id='55cce4b857654908a439b9eeea8cd800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee666204-d336-40e1-9078-de87e6e261d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee666204-d336-40e1-9078-de87e6e261d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e5d2b0-ab17-43db-b175-66e875758c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e5d2b0-ab17-43db-b175-66e875758c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ab901d7-4824-4809-a683-8a3525a31dce', 'volume_name': 'volume-0ab901d7-4824-4809-a683-8a3525a31dce', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34a8e2d0-d49d-40b0-81b5-aa06ef8612d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34a8e2d0-d49d-40b0-81b5-aa06ef8612d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d34a61-31fb-41db-94e1-d27ea3aaae94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:36 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Volume 0ab901d7-4824-4809-a683-8a3525a31dce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ab901d7-4824-4809-a683-8a3525a31dce', 'volume_size': 1} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-362562568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab901d7-4824-4809-a683-8a3525a31dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef688ecdcef941b188e5d420472adc61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:36Z,use_quota=True,user_id='55cce4b857654908a439b9eeea8cd800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Creating volume 0ab901d7-4824-4809-a683-8a3525a31dce {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:32:36 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0ab901d7-4824-4809-a683-8a3525a31dce 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:36 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0ab901d7-4824-4809-a683-8a3525a31dce 1073741824 Nov 03 08:32:36 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a9c1ac0b-1b50-4937-9443-1de6d3197c78 tempest-CinderUnicodeTest-1776522857 None] Acquiring lock "cinder-9b544be6-f501-40dc-9608-d8c54cd60d16-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a9c1ac0b-1b50-4937-9443-1de6d3197c78 tempest-CinderUnicodeTest-1776522857 None] Lock "cinder-9b544be6-f501-40dc-9608-d8c54cd60d16-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a9c1ac0b-1b50-4937-9443-1de6d3197c78 tempest-CinderUnicodeTest-1776522857 None] Acquiring lock "cinder-quobyte-9b544be6-f501-40dc-9608-d8c54cd60d16" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a9c1ac0b-1b50-4937-9443-1de6d3197c78 tempest-CinderUnicodeTest-1776522857 None] Lock "cinder-quobyte-9b544be6-f501-40dc-9608-d8c54cd60d16" acquired by "delete_volume" :: waited 0.023s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c3d102-f5f7-4bd3-938d-15e9e929792c]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a9c1ac0b-1b50-4937-9443-1de6d3197c78 tempest-CinderUnicodeTest-1776522857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Flow 'volume_create_manager' (9c6d87b1-e2fb-4cd5-937c-51e9764d1d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c144b0f-1930-4610-94e9-0203db17f64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c144b0f-1930-4610-94e9-0203db17f64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-540296599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff425ab-4529-4fa0-a32f-f7bf5ba81b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef688ecdcef941b188e5d420472adc61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:37Z,use_quota=True,user_id='55cce4b857654908a439b9eeea8cd800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1684c9f5-fa34-4679-b4a8-e70ffb655184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1684c9f5-fa34-4679-b4a8-e70ffb655184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (316bae0f-85ec-4377-bd43-ed5ddd87471a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (316bae0f-85ec-4377-bd43-ed5ddd87471a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ff425ab-4529-4fa0-a32f-f7bf5ba81b2a', 'volume_name': 'volume-7ff425ab-4529-4fa0-a32f-f7bf5ba81b2a', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1999c10b-e4bc-45d0-ac3c-3784c6a4eb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1999c10b-e4bc-45d0-ac3c-3784c6a4eb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:37 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16 Nov 03 08:32:37 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590a3280-9fe2-4a52-8859-9a8570892fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:37 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Volume 7ff425ab-4529-4fa0-a32f-f7bf5ba81b2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ff425ab-4529-4fa0-a32f-f7bf5ba81b2a', 'volume_size': 1} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-99007598-1d1f-4439-b6c5-365dfd27a406 tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "cinder-d1209423-4e8a-4260-ad95-b4f64e09e214-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-99007598-1d1f-4439-b6c5-365dfd27a406 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-d1209423-4e8a-4260-ad95-b4f64e09e214-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:37 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0ab901d7-4824-4809-a683-8a3525a31dce 1073741824" returned: 0 in 0.711s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-99007598-1d1f-4439-b6c5-365dfd27a406 tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "cinder-quobyte-d1209423-4e8a-4260-ad95-b4f64e09e214" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-99007598-1d1f-4439-b6c5-365dfd27a406 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-quobyte-d1209423-4e8a-4260-ad95-b4f64e09e214" acquired by "delete_volume" :: waited 0.027s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0ab901d7-4824-4809-a683-8a3525a31dce {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2d1bee-ae3f-4e4b-b017-d23dfc460e94]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-99007598-1d1f-4439-b6c5-365dfd27a406 tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d1209423-4e8a-4260-ad95-b4f64e09e214 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:37 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0ab901d7-4824-4809-a683-8a3525a31dce Nov 03 08:32:37 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:37 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d1209423-4e8a-4260-ad95-b4f64e09e214 Nov 03 08:32:37 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Flow 'volume_create_manager' (a087713a-9a7b-448a-be49-6318fb3ea12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c248111-bf3b-473c-b90f-b535d648c5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c248111-bf3b-473c-b90f-b535d648c5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-471365518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fb9c042-ac1a-49cd-97e7-8d93b42ecfe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef688ecdcef941b188e5d420472adc61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:38Z,use_quota=True,user_id='55cce4b857654908a439b9eeea8cd800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:37 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (442a7c0f-6740-4469-a131-8e1b2f03c2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (442a7c0f-6740-4469-a131-8e1b2f03c2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa46179-5bbc-492d-af26-b9726c3f9d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa46179-5bbc-492d-af26-b9726c3f9d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fb9c042-ac1a-49cd-97e7-8d93b42ecfe3', 'volume_name': 'volume-2fb9c042-ac1a-49cd-97e7-8d93b42ecfe3', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d44faf9d-5cf6-4f19-89e0-ee1a0e783ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d44faf9d-5cf6-4f19-89e0-ee1a0e783ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9835210a-1d3d-4463-9ccf-bd673253dfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:37 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Volume 2fb9c042-ac1a-49cd-97e7-8d93b42ecfe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fb9c042-ac1a-49cd-97e7-8d93b42ecfe3', 'volume_size': 1} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a9c1ac0b-1b50-4937-9443-1de6d3197c78 tempest-CinderUnicodeTest-1776522857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16" returned: 0 in 0.903s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a9c1ac0b-1b50-4937-9443-1de6d3197c78 tempest-CinderUnicodeTest-1776522857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:37 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16 Nov 03 08:32:37 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:37 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0ab901d7-4824-4809-a683-8a3525a31dce" returned: 0 in 0.556s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.764s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-540296599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff425ab-4529-4fa0-a32f-f7bf5ba81b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef688ecdcef941b188e5d420472adc61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:37Z,use_quota=True,user_id='55cce4b857654908a439b9eeea8cd800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Creating volume 7ff425ab-4529-4fa0-a32f-f7bf5ba81b2a {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:32:37 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ff425ab-4529-4fa0-a32f-f7bf5ba81b2a 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d34a61-31fb-41db-94e1-d27ea3aaae94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ab901d7-4824-4809-a683-8a3525a31dce', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:37 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ff425ab-4529-4fa0-a32f-f7bf5ba81b2a 1073741824 Nov 03 08:32:37 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a515c34-e045-4113-921d-1ff586d49bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:37 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:38 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Volume volume-0ab901d7-4824-4809-a683-8a3525a31dce (0ab901d7-4824-4809-a683-8a3525a31dce): created successfully Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a515c34-e045-4113-921d-1ff586d49bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:38 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Flow 'volume_create_manager' (6699b256-1ed2-49c0-85c3-15e8ff0360fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-99007598-1d1f-4439-b6c5-365dfd27a406 tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d1209423-4e8a-4260-ad95-b4f64e09e214" returned: 0 in 0.646s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-99007598-1d1f-4439-b6c5-365dfd27a406 tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d1209423-4e8a-4260-ad95-b4f64e09e214 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:38 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d1209423-4e8a-4260-ad95-b4f64e09e214 Nov 03 08:32:38 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-060122bc-739e-4f9f-9a97-5536c1372e92 tempest-CreateVolumesFromImageTest-1012361810 None] Created volume successfully. Nov 03 08:32:38 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:32:38 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Flow 'volume_create_manager' (2bc5420a-16ec-405f-8e41-ce4b655d922b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7871bc77-c5e8-446d-a801-23033e3d7a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a9c1ac0b-1b50-4937-9443-1de6d3197c78 tempest-CinderUnicodeTest-1776522857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-9b544be6-f501-40dc-9608-d8c54cd60d16" returned: 0 in 0.409s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7871bc77-c5e8-446d-a801-23033e3d7a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-470681084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea7f80d6-d53b-4da6-9f13-497f01846459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef688ecdcef941b188e5d420472adc61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:38Z,use_quota=True,user_id='55cce4b857654908a439b9eeea8cd800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f644ec-ec41-43e2-a894-589ae7ecc816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f644ec-ec41-43e2-a894-589ae7ecc816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e73328b-2738-48fe-a8a6-604998d1b953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e73328b-2738-48fe-a8a6-604998d1b953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea7f80d6-d53b-4da6-9f13-497f01846459', 'volume_name': 'volume-ea7f80d6-d53b-4da6-9f13-497f01846459', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96953dc6-65e7-446b-a537-76b3d7ba53ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96953dc6-65e7-446b-a537-76b3d7ba53ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66bd9c27-ff73-42b6-96a0-d2f248fd86d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:38 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Volume ea7f80d6-d53b-4da6-9f13-497f01846459: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea7f80d6-d53b-4da6-9f13-497f01846459', 'volume_size': 1} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a9c1ac0b-1b50-4937-9443-1de6d3197c78 tempest-CinderUnicodeTest-1776522857 None] Lock "cinder-quobyte-9b544be6-f501-40dc-9608-d8c54cd60d16" released by "delete_volume" :: held 1.529s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:38 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-99007598-1d1f-4439-b6c5-365dfd27a406 tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-d1209423-4e8a-4260-ad95-b4f64e09e214" returned: 0 in 0.452s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-99007598-1d1f-4439-b6c5-365dfd27a406 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-quobyte-d1209423-4e8a-4260-ad95-b4f64e09e214" released by "delete_volume" :: held 1.212s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-a9c1ac0b-1b50-4937-9443-1de6d3197c78 tempest-CinderUnicodeTest-1776522857 None] Created reservations ['acde0912-cff8-4c89-9e97-738196705fb9', '399cf08f-bc50-4a53-ae36-9be232f5a04c', '48ba7e36-736a-4029-bec1-13cf75615b69', 'f880ff0b-ac5c-4496-8b65-19e2a8903dd9'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a9c1ac0b-1b50-4937-9443-1de6d3197c78 tempest-CinderUnicodeTest-1776522857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a9c1ac0b-1b50-4937-9443-1de6d3197c78 tempest-CinderUnicodeTest-1776522857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a9c1ac0b-1b50-4937-9443-1de6d3197c78 tempest-CinderUnicodeTest-1776522857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a9c1ac0b-1b50-4937-9443-1de6d3197c78 tempest-CinderUnicodeTest-1776522857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a9c1ac0b-1b50-4937-9443-1de6d3197c78 tempest-CinderUnicodeTest-1776522857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a9c1ac0b-1b50-4937-9443-1de6d3197c78 tempest-CinderUnicodeTest-1776522857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-99007598-1d1f-4439-b6c5-365dfd27a406 tempest-CreateVolumesFromSnapshotTest-494543545 None] Created reservations ['19f35c44-8991-4582-a663-28ab4b95f8ae', 'c6582699-02b5-4c8f-a286-eda305bbbc30', 'e0b773ec-864e-4c52-9c51-493cbc64bebd', 'ab6b157a-4e87-4f93-a31f-e0064d5efe0f'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:32:38 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:32:38 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:38 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ff425ab-4529-4fa0-a32f-f7bf5ba81b2a 1073741824" returned: 0 in 0.809s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Flow 'volume_create_manager' (ac9000de-8ac6-4b7e-91ff-5c7e1250df2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1139467d-526f-4df8-80fd-e01ef6f11464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1139467d-526f-4df8-80fd-e01ef6f11464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1188433425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada0c9fb-ff39-4b5c-bd94-884fcb2f156e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef688ecdcef941b188e5d420472adc61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:39Z,use_quota=True,user_id='55cce4b857654908a439b9eeea8cd800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338c53c4-baf2-4509-a08d-2fbbae0856e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338c53c4-baf2-4509-a08d-2fbbae0856e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c375bfa-3f8c-4797-a0a3-ebfe1d3df395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c375bfa-3f8c-4797-a0a3-ebfe1d3df395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ada0c9fb-ff39-4b5c-bd94-884fcb2f156e', 'volume_name': 'volume-ada0c9fb-ff39-4b5c-bd94-884fcb2f156e', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08f216d-5848-42e7-ab48-6c742ca1262c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08f216d-5848-42e7-ab48-6c742ca1262c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31244ba-e886-4d86-a0e8-6bd9ba62345a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:38 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Volume ada0c9fb-ff39-4b5c-bd94-884fcb2f156e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ada0c9fb-ff39-4b5c-bd94-884fcb2f156e', 'volume_size': 1} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ff425ab-4529-4fa0-a32f-f7bf5ba81b2a {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:32:38 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ff425ab-4529-4fa0-a32f-f7bf5ba81b2a Nov 03 08:32:38 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Flow 'volume_create_manager' (a175f257-d241-47cf-809d-ab06706dcf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9fcd7f7-6556-4fc0-98c5-5cc39afc3c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:38 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-99007598-1d1f-4439-b6c5-365dfd27a406 tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-99007598-1d1f-4439-b6c5-365dfd27a406 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-99007598-1d1f-4439-b6c5-365dfd27a406 tempest-CreateVolumesFromSnapshotTest-494543545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-99007598-1d1f-4439-b6c5-365dfd27a406 tempest-CreateVolumesFromSnapshotTest-494543545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-99007598-1d1f-4439-b6c5-365dfd27a406 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-99007598-1d1f-4439-b6c5-365dfd27a406 tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a9c1ac0b-1b50-4937-9443-1de6d3197c78 tempest-CinderUnicodeTest-1776522857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.331s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:38 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-a9c1ac0b-1b50-4937-9443-1de6d3197c78 tempest-CinderUnicodeTest-1776522857 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:32:38 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:32:38 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9fcd7f7-6556-4fc0-98c5-5cc39afc3c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1744261741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45debfb3-9900-4324-85b8-7baeee85c55d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0e3a49275d4e1b8a86d8254cb779b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:39Z,use_quota=True,user_id='d3bacc1a887443c8a27195fd05f4f57d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cec33a3-0686-41fd-add0-02f4fed99b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cec33a3-0686-41fd-add0-02f4fed99b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86af0913-c6f5-46ba-83b0-4cc71e745697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86af0913-c6f5-46ba-83b0-4cc71e745697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45debfb3-9900-4324-85b8-7baeee85c55d', 'volume_name': 'volume-45debfb3-9900-4324-85b8-7baeee85c55d', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8ef042-35b8-4093-9598-8cccc345db3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8ef042-35b8-4093-9598-8cccc345db3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ab99be-bbff-4b57-907e-1b1a6b2cd2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:39 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Volume 45debfb3-9900-4324-85b8-7baeee85c55d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45debfb3-9900-4324-85b8-7baeee85c55d', 'volume_size': 1} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:39 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-a9c1ac0b-1b50-4937-9443-1de6d3197c78 tempest-CinderUnicodeTest-1776522857 None] Deleted volume successfully. Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a9c1ac0b-1b50-4937-9443-1de6d3197c78 tempest-CinderUnicodeTest-1776522857 None] Lock "cinder-9b544be6-f501-40dc-9608-d8c54cd60d16-delete_volume" released by "delete_volume" :: held 2.261s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:39 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ff425ab-4529-4fa0-a32f-f7bf5ba81b2a" returned: 0 in 0.272s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.355s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-471365518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fb9c042-ac1a-49cd-97e7-8d93b42ecfe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef688ecdcef941b188e5d420472adc61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:38Z,use_quota=True,user_id='55cce4b857654908a439b9eeea8cd800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Creating volume 2fb9c042-ac1a-49cd-97e7-8d93b42ecfe3 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:32:39 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2fb9c042-ac1a-49cd-97e7-8d93b42ecfe3 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590a3280-9fe2-4a52-8859-9a8570892fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ff425ab-4529-4fa0-a32f-f7bf5ba81b2a', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:39 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2fb9c042-ac1a-49cd-97e7-8d93b42ecfe3 1073741824 Nov 03 08:32:39 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:39 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (338acb48-43b8-4219-b1a7-cf224f35f465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-99007598-1d1f-4439-b6c5-365dfd27a406 tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.261s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-99007598-1d1f-4439-b6c5-365dfd27a406 tempest-CreateVolumesFromSnapshotTest-494543545 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:32:39 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-99007598-1d1f-4439-b6c5-365dfd27a406 tempest-CreateVolumesFromSnapshotTest-494543545 None] Deleted volume successfully. Nov 03 08:32:39 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Volume volume-7ff425ab-4529-4fa0-a32f-f7bf5ba81b2a (7ff425ab-4529-4fa0-a32f-f7bf5ba81b2a): created successfully Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (338acb48-43b8-4219-b1a7-cf224f35f465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Flow 'volume_create_manager' (9c6d87b1-e2fb-4cd5-937c-51e9764d1d05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-99007598-1d1f-4439-b6c5-365dfd27a406 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-d1209423-4e8a-4260-ad95-b4f64e09e214-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:39 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-aba38368-abad-4f25-8750-83dc61d1026e tempest-CreateVolumesFromImageTest-1012361810 None] Created volume successfully. Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b5bc2985-901c-437d-8eff-8305e3ef949a tempest-CinderUnicodeTest-1776522857 None] Acquiring lock "cinder-f2fab205-f36b-4c77-9fc9-38bae1241b47-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b5bc2985-901c-437d-8eff-8305e3ef949a tempest-CinderUnicodeTest-1776522857 None] Lock "cinder-f2fab205-f36b-4c77-9fc9-38bae1241b47-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4b553cf0-86c8-4b12-b8b8-7843f9846cce tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "cinder-cfb0491f-18a1-4b3a-b5aa-2182d75b7e89-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b5bc2985-901c-437d-8eff-8305e3ef949a tempest-CinderUnicodeTest-1776522857 None] Acquiring lock "cinder-quobyte-f2fab205-f36b-4c77-9fc9-38bae1241b47" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4b553cf0-86c8-4b12-b8b8-7843f9846cce tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-cfb0491f-18a1-4b3a-b5aa-2182d75b7e89-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b5bc2985-901c-437d-8eff-8305e3ef949a tempest-CinderUnicodeTest-1776522857 None] Lock "cinder-quobyte-f2fab205-f36b-4c77-9fc9-38bae1241b47" acquired by "delete_volume" :: waited 0.028s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:39 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2fb9c042-ac1a-49cd-97e7-8d93b42ecfe3 1073741824" returned: 0 in 0.513s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6ecb71-d041-4179-8814-55acde3ea47b]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b5bc2985-901c-437d-8eff-8305e3ef949a tempest-CinderUnicodeTest-1776522857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f2fab205-f36b-4c77-9fc9-38bae1241b47 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4b553cf0-86c8-4b12-b8b8-7843f9846cce tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "cinder-quobyte-cfb0491f-18a1-4b3a-b5aa-2182d75b7e89" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2fb9c042-ac1a-49cd-97e7-8d93b42ecfe3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4b553cf0-86c8-4b12-b8b8-7843f9846cce tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-quobyte-cfb0491f-18a1-4b3a-b5aa-2182d75b7e89" acquired by "delete_volume" :: waited 0.035s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:39 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2fb9c042-ac1a-49cd-97e7-8d93b42ecfe3 Nov 03 08:32:39 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b25fee5-b249-44fd-9b03-9eef4143402a]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4b553cf0-86c8-4b12-b8b8-7843f9846cce tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cfb0491f-18a1-4b3a-b5aa-2182d75b7e89 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:39 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f2fab205-f36b-4c77-9fc9-38bae1241b47 Nov 03 08:32:39 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:39 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cfb0491f-18a1-4b3a-b5aa-2182d75b7e89 Nov 03 08:32:39 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:40 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2fb9c042-ac1a-49cd-97e7-8d93b42ecfe3" returned: 0 in 0.335s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.727s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-470681084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea7f80d6-d53b-4da6-9f13-497f01846459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef688ecdcef941b188e5d420472adc61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:38Z,use_quota=True,user_id='55cce4b857654908a439b9eeea8cd800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Creating volume ea7f80d6-d53b-4da6-9f13-497f01846459 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:32:40 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:32:40 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ea7f80d6-d53b-4da6-9f13-497f01846459 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b5bc2985-901c-437d-8eff-8305e3ef949a tempest-CinderUnicodeTest-1776522857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f2fab205-f36b-4c77-9fc9-38bae1241b47" returned: 0 in 0.430s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b5bc2985-901c-437d-8eff-8305e3ef949a tempest-CinderUnicodeTest-1776522857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f2fab205-f36b-4c77-9fc9-38bae1241b47 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:40 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ea7f80d6-d53b-4da6-9f13-497f01846459 1073741824 Nov 03 08:32:40 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9835210a-1d3d-4463-9ccf-bd673253dfd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fb9c042-ac1a-49cd-97e7-8d93b42ecfe3', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ecef42-a55a-4972-b58c-9c78631a8055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:40 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f2fab205-f36b-4c77-9fc9-38bae1241b47 Nov 03 08:32:40 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:40 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Volume volume-2fb9c042-ac1a-49cd-97e7-8d93b42ecfe3 (2fb9c042-ac1a-49cd-97e7-8d93b42ecfe3): created successfully Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ecef42-a55a-4972-b58c-9c78631a8055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Flow 'volume_create_manager' (a087713a-9a7b-448a-be49-6318fb3ea12f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:40 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-dbf937d7-c82a-41cf-87dc-3a1bb4efdfa9 tempest-CreateVolumesFromImageTest-1012361810 None] Created volume successfully. Nov 03 08:32:40 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4b553cf0-86c8-4b12-b8b8-7843f9846cce tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cfb0491f-18a1-4b3a-b5aa-2182d75b7e89" returned: 0 in 0.407s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4b553cf0-86c8-4b12-b8b8-7843f9846cce tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cfb0491f-18a1-4b3a-b5aa-2182d75b7e89 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:40 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cfb0491f-18a1-4b3a-b5aa-2182d75b7e89 Nov 03 08:32:40 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:40 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b5bc2985-901c-437d-8eff-8305e3ef949a tempest-CinderUnicodeTest-1776522857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-f2fab205-f36b-4c77-9fc9-38bae1241b47" returned: 0 in 0.258s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b5bc2985-901c-437d-8eff-8305e3ef949a tempest-CinderUnicodeTest-1776522857 None] Lock "cinder-quobyte-f2fab205-f36b-4c77-9fc9-38bae1241b47" released by "delete_volume" :: held 0.745s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-b5bc2985-901c-437d-8eff-8305e3ef949a tempest-CinderUnicodeTest-1776522857 None] Created reservations ['32fe1a0f-f958-4d47-906e-d498f975e66d', 'd48f5200-4849-41d8-ab03-ee6e88ae634a', '36ada790-97ca-40e1-a5e3-28b290b060ea', '300e7fac-a50e-4b03-bdcc-325b561f6eb4'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:32:40 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4b553cf0-86c8-4b12-b8b8-7843f9846cce tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cfb0491f-18a1-4b3a-b5aa-2182d75b7e89" returned: 0 in 0.294s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4b553cf0-86c8-4b12-b8b8-7843f9846cce tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-quobyte-cfb0491f-18a1-4b3a-b5aa-2182d75b7e89" released by "delete_volume" :: held 0.770s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b5bc2985-901c-437d-8eff-8305e3ef949a tempest-CinderUnicodeTest-1776522857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b5bc2985-901c-437d-8eff-8305e3ef949a tempest-CinderUnicodeTest-1776522857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b5bc2985-901c-437d-8eff-8305e3ef949a tempest-CinderUnicodeTest-1776522857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b5bc2985-901c-437d-8eff-8305e3ef949a tempest-CinderUnicodeTest-1776522857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b5bc2985-901c-437d-8eff-8305e3ef949a tempest-CinderUnicodeTest-1776522857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b5bc2985-901c-437d-8eff-8305e3ef949a tempest-CinderUnicodeTest-1776522857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:40 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:32:40 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-4b553cf0-86c8-4b12-b8b8-7843f9846cce tempest-CreateVolumesFromSnapshotTest-494543545 None] Created reservations ['09d2c78f-5763-43c9-bd91-1c307e3e162d', 'd45a72f5-c47e-4b84-ba4e-2aa58d8d649b', 'b952ff12-6dcf-4c59-991a-cee314ff8c6d', '5d417bcb-8c9b-4d0b-94de-c470a305c0a2'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:32:40 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ea7f80d6-d53b-4da6-9f13-497f01846459 1073741824" returned: 0 in 0.537s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4b553cf0-86c8-4b12-b8b8-7843f9846cce tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4b553cf0-86c8-4b12-b8b8-7843f9846cce tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4b553cf0-86c8-4b12-b8b8-7843f9846cce tempest-CreateVolumesFromSnapshotTest-494543545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4b553cf0-86c8-4b12-b8b8-7843f9846cce tempest-CreateVolumesFromSnapshotTest-494543545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4b553cf0-86c8-4b12-b8b8-7843f9846cce tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4b553cf0-86c8-4b12-b8b8-7843f9846cce tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ea7f80d6-d53b-4da6-9f13-497f01846459 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:40 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:32:40 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ea7f80d6-d53b-4da6-9f13-497f01846459 Nov 03 08:32:40 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:40 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e85bb4c6-99dc-4e5a-8eee-0a2c7c5dc648 tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "cinder-c154f612-68ef-48f7-8394-dce9246de819-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:40 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b5bc2985-901c-437d-8eff-8305e3ef949a tempest-CinderUnicodeTest-1776522857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.324s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-b5bc2985-901c-437d-8eff-8305e3ef949a tempest-CinderUnicodeTest-1776522857 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e85bb4c6-99dc-4e5a-8eee-0a2c7c5dc648 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-c154f612-68ef-48f7-8394-dce9246de819-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e85bb4c6-99dc-4e5a-8eee-0a2c7c5dc648 tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "cinder-quobyte-906a48dc-3259-4205-b881-b9b4eabed7bd" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:40 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-b5bc2985-901c-437d-8eff-8305e3ef949a tempest-CinderUnicodeTest-1776522857 None] Deleted volume successfully. Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e85bb4c6-99dc-4e5a-8eee-0a2c7c5dc648 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-quobyte-906a48dc-3259-4205-b881-b9b4eabed7bd" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e85bb4c6-99dc-4e5a-8eee-0a2c7c5dc648 tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "cinder-quobyte-c154f612-68ef-48f7-8394-dce9246de819" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b5bc2985-901c-437d-8eff-8305e3ef949a tempest-CinderUnicodeTest-1776522857 None] Lock "cinder-f2fab205-f36b-4c77-9fc9-38bae1241b47-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e85bb4c6-99dc-4e5a-8eee-0a2c7c5dc648 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-quobyte-c154f612-68ef-48f7-8394-dce9246de819" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-e85bb4c6-99dc-4e5a-8eee-0a2c7c5dc648 tempest-CreateVolumesFromSnapshotTest-494543545 None] Deleting offline snapshot c154f612-68ef-48f7-8394-dce9246de819 of volume 906a48dc-3259-4205-b881-b9b4eabed7bd {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-e85bb4c6-99dc-4e5a-8eee-0a2c7c5dc648 tempest-CreateVolumesFromSnapshotTest-494543545 None] snapshot_file for this snap is: volume-906a48dc-3259-4205-b881-b9b4eabed7bd.c154f612-68ef-48f7-8394-dce9246de819 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4183312-6634-43cb-9847-f76944907f66]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e85bb4c6-99dc-4e5a-8eee-0a2c7c5dc648 tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd.c154f612-68ef-48f7-8394-dce9246de819 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:41 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ea7f80d6-d53b-4da6-9f13-497f01846459" returned: 0 in 0.367s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.246s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1188433425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada0c9fb-ff39-4b5c-bd94-884fcb2f156e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef688ecdcef941b188e5d420472adc61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:39Z,use_quota=True,user_id='55cce4b857654908a439b9eeea8cd800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Creating volume ada0c9fb-ff39-4b5c-bd94-884fcb2f156e {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:32:41 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ada0c9fb-ff39-4b5c-bd94-884fcb2f156e 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:41 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66bd9c27-ff73-42b6-96a0-d2f248fd86d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea7f80d6-d53b-4da6-9f13-497f01846459', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:41 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ada0c9fb-ff39-4b5c-bd94-884fcb2f156e 1073741824 Nov 03 08:32:41 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9bd2579-7f5d-4799-88aa-17ae76f46dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4b553cf0-86c8-4b12-b8b8-7843f9846cce tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.488s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:41 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd.c154f612-68ef-48f7-8394-dce9246de819 Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-4b553cf0-86c8-4b12-b8b8-7843f9846cce tempest-CreateVolumesFromSnapshotTest-494543545 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:32:41 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:41 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-4b553cf0-86c8-4b12-b8b8-7843f9846cce tempest-CreateVolumesFromSnapshotTest-494543545 None] Deleted volume successfully. Nov 03 08:32:41 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Volume volume-ea7f80d6-d53b-4da6-9f13-497f01846459 (ea7f80d6-d53b-4da6-9f13-497f01846459): created successfully Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9bd2579-7f5d-4799-88aa-17ae76f46dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Flow 'volume_create_manager' (2bc5420a-16ec-405f-8e41-ce4b655d922b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:41 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-6c2854f2-4fa5-4ee7-aef6-6ab8e783f7b6 tempest-CreateVolumesFromImageTest-1012361810 None] Created volume successfully. Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4b553cf0-86c8-4b12-b8b8-7843f9846cce tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-cfb0491f-18a1-4b3a-b5aa-2182d75b7e89-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:41 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e85bb4c6-99dc-4e5a-8eee-0a2c7c5dc648 tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd.c154f612-68ef-48f7-8394-dce9246de819" returned: 0 in 0.439s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-e85bb4c6-99dc-4e5a-8eee-0a2c7c5dc648 tempest-CreateVolumesFromSnapshotTest-494543545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-906a48dc-3259-4205-b881-b9b4eabed7bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[a658bfc5-309a-4ba6-8fc5-28c6e0bf6d45]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e85bb4c6-99dc-4e5a-8eee-0a2c7c5dc648 tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:41 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd Nov 03 08:32:41 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:41 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ada0c9fb-ff39-4b5c-bd94-884fcb2f156e 1073741824" returned: 0 in 0.560s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ada0c9fb-ff39-4b5c-bd94-884fcb2f156e {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:41 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ada0c9fb-ff39-4b5c-bd94-884fcb2f156e Nov 03 08:32:41 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:41 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e85bb4c6-99dc-4e5a-8eee-0a2c7c5dc648 tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd" returned: 0 in 0.449s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e85bb4c6-99dc-4e5a-8eee-0a2c7c5dc648 tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd.c154f612-68ef-48f7-8394-dce9246de819 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:42 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ada0c9fb-ff39-4b5c-bd94-884fcb2f156e" returned: 0 in 0.278s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:42 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd.c154f612-68ef-48f7-8394-dce9246de819 Nov 03 08:32:42 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.993s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1744261741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45debfb3-9900-4324-85b8-7baeee85c55d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0e3a49275d4e1b8a86d8254cb779b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:39Z,use_quota=True,user_id='d3bacc1a887443c8a27195fd05f4f57d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Creating volume 45debfb3-9900-4324-85b8-7baeee85c55d {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:32:42 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31244ba-e886-4d86-a0e8-6bd9ba62345a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ada0c9fb-ff39-4b5c-bd94-884fcb2f156e', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c01c513a-df71-4fc4-aaa2-fb8ba6a7cf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:42 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d 1073741824 Nov 03 08:32:42 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:42 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Volume volume-ada0c9fb-ff39-4b5c-bd94-884fcb2f156e (ada0c9fb-ff39-4b5c-bd94-884fcb2f156e): created successfully Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c01c513a-df71-4fc4-aaa2-fb8ba6a7cf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Flow 'volume_create_manager' (ac9000de-8ac6-4b7e-91ff-5c7e1250df2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:42 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-c47c8781-6955-46c2-9870-28d9f7c00e20 tempest-CreateVolumesFromImageTest-1012361810 None] Created volume successfully. Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ab35b60f-512b-4988-9b01-29741e2d3208 tempest-CreateVolumesFromImageTest-1012361810 None] Acquiring lock "cinder-ada0c9fb-ff39-4b5c-bd94-884fcb2f156e-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ab35b60f-512b-4988-9b01-29741e2d3208 tempest-CreateVolumesFromImageTest-1012361810 None] Lock "cinder-ada0c9fb-ff39-4b5c-bd94-884fcb2f156e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ab35b60f-512b-4988-9b01-29741e2d3208 tempest-CreateVolumesFromImageTest-1012361810 None] Acquiring lock "cinder-quobyte-ada0c9fb-ff39-4b5c-bd94-884fcb2f156e" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ab35b60f-512b-4988-9b01-29741e2d3208 tempest-CreateVolumesFromImageTest-1012361810 None] Lock "cinder-quobyte-ada0c9fb-ff39-4b5c-bd94-884fcb2f156e" acquired by "delete_volume" :: waited 0.030s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa5e168-9e8d-4abf-baf5-1a2952a2057e]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ab35b60f-512b-4988-9b01-29741e2d3208 tempest-CreateVolumesFromImageTest-1012361810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ada0c9fb-ff39-4b5c-bd94-884fcb2f156e {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:42 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e85bb4c6-99dc-4e5a-8eee-0a2c7c5dc648 tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd.c154f612-68ef-48f7-8394-dce9246de819" returned: 0 in 0.554s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e85bb4c6-99dc-4e5a-8eee-0a2c7c5dc648 tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd.c154f612-68ef-48f7-8394-dce9246de819 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:42 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd.c154f612-68ef-48f7-8394-dce9246de819 Nov 03 08:32:42 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:42 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ada0c9fb-ff39-4b5c-bd94-884fcb2f156e Nov 03 08:32:42 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:42 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d 1073741824" returned: 0 in 0.614s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:42 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d Nov 03 08:32:42 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:42 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e85bb4c6-99dc-4e5a-8eee-0a2c7c5dc648 tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd.c154f612-68ef-48f7-8394-dce9246de819" returned: 0 in 0.314s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:42 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ab35b60f-512b-4988-9b01-29741e2d3208 tempest-CreateVolumesFromImageTest-1012361810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ada0c9fb-ff39-4b5c-bd94-884fcb2f156e" returned: 0 in 0.447s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ab35b60f-512b-4988-9b01-29741e2d3208 tempest-CreateVolumesFromImageTest-1012361810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ada0c9fb-ff39-4b5c-bd94-884fcb2f156e {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e85bb4c6-99dc-4e5a-8eee-0a2c7c5dc648 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-quobyte-c154f612-68ef-48f7-8394-dce9246de819" released by "_delete_snapshot" :: held 1.934s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e85bb4c6-99dc-4e5a-8eee-0a2c7c5dc648 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-quobyte-906a48dc-3259-4205-b881-b9b4eabed7bd" released by "delete_snapshot" :: held 1.995s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:42 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ada0c9fb-ff39-4b5c-bd94-884fcb2f156e Nov 03 08:32:42 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:43 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d" returned: 0 in 0.290s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ab99be-bbff-4b57-907e-1b1a6b2cd2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45debfb3-9900-4324-85b8-7baeee85c55d', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3025d91-e093-4bed-9c74-ce19a64357a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-e85bb4c6-99dc-4e5a-8eee-0a2c7c5dc648 tempest-CreateVolumesFromSnapshotTest-494543545 None] Created reservations ['ad488263-3752-4e00-acb7-25d79266cc85', 'cda387d2-a302-40c0-b234-3f3751c7f95c', '5a1c3300-70a0-4156-9664-0d1723bbdc91', 'c9805ff3-dad2-4238-8e94-b21a678e0536'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:32:43 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Volume volume-45debfb3-9900-4324-85b8-7baeee85c55d (45debfb3-9900-4324-85b8-7baeee85c55d): created successfully Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3025d91-e093-4bed-9c74-ce19a64357a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Flow 'volume_create_manager' (a175f257-d241-47cf-809d-ab06706dcf51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:43 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-8e143c40-ac9a-48c9-a0ab-0f9d3aaa3a2f tempest-VolumeDependencyTests-1192107025 None] Created volume successfully. Nov 03 08:32:43 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-e85bb4c6-99dc-4e5a-8eee-0a2c7c5dc648 tempest-CreateVolumesFromSnapshotTest-494543545 None] Delete snapshot completed successfully. Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e85bb4c6-99dc-4e5a-8eee-0a2c7c5dc648 tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-c154f612-68ef-48f7-8394-dce9246de819-delete_snapshot" released by "delete_snapshot" :: held 2.215s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:43 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ab35b60f-512b-4988-9b01-29741e2d3208 tempest-CreateVolumesFromImageTest-1012361810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ada0c9fb-ff39-4b5c-bd94-884fcb2f156e" returned: 0 in 0.302s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ab35b60f-512b-4988-9b01-29741e2d3208 tempest-CreateVolumesFromImageTest-1012361810 None] Lock "cinder-quobyte-ada0c9fb-ff39-4b5c-bd94-884fcb2f156e" released by "delete_volume" :: held 0.802s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-ab35b60f-512b-4988-9b01-29741e2d3208 tempest-CreateVolumesFromImageTest-1012361810 None] Created reservations ['bafd5499-7e72-46c0-adc0-57b22a568f3c', '1457cfec-9c7b-4274-b0c5-6ef0711f81fc', '7f3c8759-8248-46a1-9db2-9ac59b757012', 'a70d244b-8d08-4f4a-b463-96817eead93f'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ab35b60f-512b-4988-9b01-29741e2d3208 tempest-CreateVolumesFromImageTest-1012361810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ab35b60f-512b-4988-9b01-29741e2d3208 tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ab35b60f-512b-4988-9b01-29741e2d3208 tempest-CreateVolumesFromImageTest-1012361810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ab35b60f-512b-4988-9b01-29741e2d3208 tempest-CreateVolumesFromImageTest-1012361810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ab35b60f-512b-4988-9b01-29741e2d3208 tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ab35b60f-512b-4988-9b01-29741e2d3208 tempest-CreateVolumesFromImageTest-1012361810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:43 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:32:43 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d8fd5fd6-ff66-4ee7-bdeb-7a7884864a9e tempest-CreateVolumesFromImageTest-1012361810 None] Acquiring lock "cinder-ea7f80d6-d53b-4da6-9f13-497f01846459-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b2cd0df7-e767-42d5-892a-3e66a905254e tempest-VolumeDependencyTests-1192107025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b2cd0df7-e767-42d5-892a-3e66a905254e tempest-VolumeDependencyTests-1192107025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-b2cd0df7-e767-42d5-892a-3e66a905254e tempest-VolumeDependencyTests-1192107025 None] Creating offline snapshot a5b9b95a-9ae3-4075-8821-e31cf8e59922 of volume 45debfb3-9900-4324-85b8-7baeee85c55d {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d8fd5fd6-ff66-4ee7-bdeb-7a7884864a9e tempest-CreateVolumesFromImageTest-1012361810 None] Lock "cinder-ea7f80d6-d53b-4da6-9f13-497f01846459-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[82eb8861-36ed-4273-8bb0-efd830304f48]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b2cd0df7-e767-42d5-892a-3e66a905254e tempest-VolumeDependencyTests-1192107025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:43 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ab35b60f-512b-4988-9b01-29741e2d3208 tempest-CreateVolumesFromImageTest-1012361810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.323s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-ab35b60f-512b-4988-9b01-29741e2d3208 tempest-CreateVolumesFromImageTest-1012361810 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d8fd5fd6-ff66-4ee7-bdeb-7a7884864a9e tempest-CreateVolumesFromImageTest-1012361810 None] Acquiring lock "cinder-quobyte-ea7f80d6-d53b-4da6-9f13-497f01846459" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:43 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-ab35b60f-512b-4988-9b01-29741e2d3208 tempest-CreateVolumesFromImageTest-1012361810 None] Deleted volume successfully. Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d8fd5fd6-ff66-4ee7-bdeb-7a7884864a9e tempest-CreateVolumesFromImageTest-1012361810 None] Lock "cinder-quobyte-ea7f80d6-d53b-4da6-9f13-497f01846459" acquired by "delete_volume" :: waited 0.035s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ab35b60f-512b-4988-9b01-29741e2d3208 tempest-CreateVolumesFromImageTest-1012361810 None] Lock "cinder-ada0c9fb-ff39-4b5c-bd94-884fcb2f156e-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba8fae5-9449-4e4c-8583-001f97596ca2]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d8fd5fd6-ff66-4ee7-bdeb-7a7884864a9e tempest-CreateVolumesFromImageTest-1012361810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ea7f80d6-d53b-4da6-9f13-497f01846459 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:43 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d Nov 03 08:32:43 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:43 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ea7f80d6-d53b-4da6-9f13-497f01846459 Nov 03 08:32:43 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-eee26cdd-2ba2-4a0f-9a72-0057ef3a080b tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "cinder-906a48dc-3259-4205-b881-b9b4eabed7bd-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:44 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b2cd0df7-e767-42d5-892a-3e66a905254e tempest-VolumeDependencyTests-1192107025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d" returned: 0 in 0.447s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b2cd0df7-e767-42d5-892a-3e66a905254e tempest-VolumeDependencyTests-1192107025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.a5b9b95a-9ae3-4075-8821-e31cf8e59922 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:44 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.a5b9b95a-9ae3-4075-8821-e31cf8e59922 1G Nov 03 08:32:44 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-eee26cdd-2ba2-4a0f-9a72-0057ef3a080b tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-906a48dc-3259-4205-b881-b9b4eabed7bd-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-eee26cdd-2ba2-4a0f-9a72-0057ef3a080b tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "cinder-quobyte-906a48dc-3259-4205-b881-b9b4eabed7bd" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-eee26cdd-2ba2-4a0f-9a72-0057ef3a080b tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-quobyte-906a48dc-3259-4205-b881-b9b4eabed7bd" acquired by "delete_volume" :: waited 0.016s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:44 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d8fd5fd6-ff66-4ee7-bdeb-7a7884864a9e tempest-CreateVolumesFromImageTest-1012361810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ea7f80d6-d53b-4da6-9f13-497f01846459" returned: 0 in 0.497s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d8fd5fd6-ff66-4ee7-bdeb-7a7884864a9e tempest-CreateVolumesFromImageTest-1012361810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ea7f80d6-d53b-4da6-9f13-497f01846459 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:44 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d268c9-59f6-4f57-9fce-6920ee4f5d1a]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eee26cdd-2ba2-4a0f-9a72-0057ef3a080b tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:44 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ea7f80d6-d53b-4da6-9f13-497f01846459 Nov 03 08:32:44 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:44 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd Nov 03 08:32:44 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:44 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d8fd5fd6-ff66-4ee7-bdeb-7a7884864a9e tempest-CreateVolumesFromImageTest-1012361810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ea7f80d6-d53b-4da6-9f13-497f01846459" returned: 0 in 0.346s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d8fd5fd6-ff66-4ee7-bdeb-7a7884864a9e tempest-CreateVolumesFromImageTest-1012361810 None] Lock "cinder-quobyte-ea7f80d6-d53b-4da6-9f13-497f01846459" released by "delete_volume" :: held 0.897s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:44 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b2cd0df7-e767-42d5-892a-3e66a905254e tempest-VolumeDependencyTests-1192107025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.a5b9b95a-9ae3-4075-8821-e31cf8e59922 1G" returned: 0 in 0.540s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b2cd0df7-e767-42d5-892a-3e66a905254e tempest-VolumeDependencyTests-1192107025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45debfb3-9900-4324-85b8-7baeee85c55d -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.a5b9b95a-9ae3-4075-8821-e31cf8e59922 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:44 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:44 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45debfb3-9900-4324-85b8-7baeee85c55d -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.a5b9b95a-9ae3-4075-8821-e31cf8e59922 Nov 03 08:32:44 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eee26cdd-2ba2-4a0f-9a72-0057ef3a080b tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd" returned: 0 in 0.424s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eee26cdd-2ba2-4a0f-9a72-0057ef3a080b tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:44 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd Nov 03 08:32:44 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:44 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-d8fd5fd6-ff66-4ee7-bdeb-7a7884864a9e tempest-CreateVolumesFromImageTest-1012361810 None] Created reservations ['d95efa01-10a4-4e63-b6fe-14b2f1b3e529', 'd2ae27d4-ac7c-497b-b688-c6f93909a309', '2d4198ef-9c5e-4e66-8816-c8eabafede7d', '94d2d67b-1c5b-41a8-8553-6841aed109ea'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:32:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d8fd5fd6-ff66-4ee7-bdeb-7a7884864a9e tempest-CreateVolumesFromImageTest-1012361810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d8fd5fd6-ff66-4ee7-bdeb-7a7884864a9e tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:44 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d8fd5fd6-ff66-4ee7-bdeb-7a7884864a9e tempest-CreateVolumesFromImageTest-1012361810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:44 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d8fd5fd6-ff66-4ee7-bdeb-7a7884864a9e tempest-CreateVolumesFromImageTest-1012361810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d8fd5fd6-ff66-4ee7-bdeb-7a7884864a9e tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d8fd5fd6-ff66-4ee7-bdeb-7a7884864a9e tempest-CreateVolumesFromImageTest-1012361810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:44 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:32:44 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:45 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b2cd0df7-e767-42d5-892a-3e66a905254e tempest-VolumeDependencyTests-1192107025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45debfb3-9900-4324-85b8-7baeee85c55d -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.a5b9b95a-9ae3-4075-8821-e31cf8e59922" returned: 0 in 0.368s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:45 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-b2cd0df7-e767-42d5-892a-3e66a905254e tempest-VolumeDependencyTests-1192107025 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.a5b9b95a-9ae3-4075-8821-e31cf8e59922 is being set with open permissions: ugo+rw Nov 03 08:32:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b2cd0df7-e767-42d5-892a-3e66a905254e tempest-VolumeDependencyTests-1192107025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.a5b9b95a-9ae3-4075-8821-e31cf8e59922 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:45 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eee26cdd-2ba2-4a0f-9a72-0057ef3a080b tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-906a48dc-3259-4205-b881-b9b4eabed7bd" returned: 0 in 0.333s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:45 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.a5b9b95a-9ae3-4075-8821-e31cf8e59922 Nov 03 08:32:45 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:45 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-eee26cdd-2ba2-4a0f-9a72-0057ef3a080b tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-quobyte-906a48dc-3259-4205-b881-b9b4eabed7bd" released by "delete_volume" :: held 0.843s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:45 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-eee26cdd-2ba2-4a0f-9a72-0057ef3a080b tempest-CreateVolumesFromSnapshotTest-494543545 None] Created reservations ['6d7a3769-1f0c-4c6c-9376-5ca0f46e35a3', '6ee6143e-e7ab-4a31-9ecc-65305d275da7', 'e411a20a-3c2c-464c-8220-14b7380c727e', '0a5d20bb-994f-47a3-999e-413181623498'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:32:45 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d8fd5fd6-ff66-4ee7-bdeb-7a7884864a9e tempest-CreateVolumesFromImageTest-1012361810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.336s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:45 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-d8fd5fd6-ff66-4ee7-bdeb-7a7884864a9e tempest-CreateVolumesFromImageTest-1012361810 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:32:45 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-d8fd5fd6-ff66-4ee7-bdeb-7a7884864a9e tempest-CreateVolumesFromImageTest-1012361810 None] Deleted volume successfully. Nov 03 08:32:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-eee26cdd-2ba2-4a0f-9a72-0057ef3a080b tempest-CreateVolumesFromSnapshotTest-494543545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-eee26cdd-2ba2-4a0f-9a72-0057ef3a080b tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:45 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-eee26cdd-2ba2-4a0f-9a72-0057ef3a080b tempest-CreateVolumesFromSnapshotTest-494543545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:45 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-eee26cdd-2ba2-4a0f-9a72-0057ef3a080b tempest-CreateVolumesFromSnapshotTest-494543545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-eee26cdd-2ba2-4a0f-9a72-0057ef3a080b tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eee26cdd-2ba2-4a0f-9a72-0057ef3a080b tempest-CreateVolumesFromSnapshotTest-494543545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:45 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d8fd5fd6-ff66-4ee7-bdeb-7a7884864a9e tempest-CreateVolumesFromImageTest-1012361810 None] Lock "cinder-ea7f80d6-d53b-4da6-9f13-497f01846459-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:45 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:32:45 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:45 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b2cd0df7-e767-42d5-892a-3e66a905254e tempest-VolumeDependencyTests-1192107025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.a5b9b95a-9ae3-4075-8821-e31cf8e59922" returned: 0 in 0.325s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b2cd0df7-e767-42d5-892a-3e66a905254e tempest-VolumeDependencyTests-1192107025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:45 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.info Nov 03 08:32:45 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:45 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eee26cdd-2ba2-4a0f-9a72-0057ef3a080b tempest-CreateVolumesFromSnapshotTest-494543545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.307s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:45 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-eee26cdd-2ba2-4a0f-9a72-0057ef3a080b tempest-CreateVolumesFromSnapshotTest-494543545 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:32:45 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-eee26cdd-2ba2-4a0f-9a72-0057ef3a080b tempest-CreateVolumesFromSnapshotTest-494543545 None] Deleted volume successfully. Nov 03 08:32:45 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-eee26cdd-2ba2-4a0f-9a72-0057ef3a080b tempest-CreateVolumesFromSnapshotTest-494543545 None] Lock "cinder-906a48dc-3259-4205-b881-b9b4eabed7bd-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:45 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b2cd0df7-e767-42d5-892a-3e66a905254e tempest-VolumeDependencyTests-1192107025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.info" returned: 0 in 0.325s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:45 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-b2cd0df7-e767-42d5-892a-3e66a905254e tempest-VolumeDependencyTests-1192107025 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.info is being set with open permissions: ugo+rw Nov 03 08:32:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b2cd0df7-e767-42d5-892a-3e66a905254e tempest-VolumeDependencyTests-1192107025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:45 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.info Nov 03 08:32:45 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:45 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e6013a3c-8284-40cc-92bd-78b72ad9df2a tempest-CreateVolumesFromImageTest-1012361810 None] Acquiring lock "cinder-2fb9c042-ac1a-49cd-97e7-8d93b42ecfe3-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:45 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e6013a3c-8284-40cc-92bd-78b72ad9df2a tempest-CreateVolumesFromImageTest-1012361810 None] Lock "cinder-2fb9c042-ac1a-49cd-97e7-8d93b42ecfe3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:45 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e6013a3c-8284-40cc-92bd-78b72ad9df2a tempest-CreateVolumesFromImageTest-1012361810 None] Acquiring lock "cinder-quobyte-2fb9c042-ac1a-49cd-97e7-8d93b42ecfe3" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:45 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e6013a3c-8284-40cc-92bd-78b72ad9df2a tempest-CreateVolumesFromImageTest-1012361810 None] Lock "cinder-quobyte-2fb9c042-ac1a-49cd-97e7-8d93b42ecfe3" acquired by "delete_volume" :: waited 0.018s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:46 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba10e395-6f4b-4bdb-a368-7760f5e62928]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e6013a3c-8284-40cc-92bd-78b72ad9df2a tempest-CreateVolumesFromImageTest-1012361810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2fb9c042-ac1a-49cd-97e7-8d93b42ecfe3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:46 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b2cd0df7-e767-42d5-892a-3e66a905254e tempest-VolumeDependencyTests-1192107025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.info" returned: 0 in 0.393s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:46 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2fb9c042-ac1a-49cd-97e7-8d93b42ecfe3 Nov 03 08:32:46 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b2cd0df7-e767-42d5-892a-3e66a905254e tempest-VolumeDependencyTests-1192107025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.563s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:46 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-b2cd0df7-e767-42d5-892a-3e66a905254e tempest-VolumeDependencyTests-1192107025 None] Create snapshot completed successfully Nov 03 08:32:46 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e6013a3c-8284-40cc-92bd-78b72ad9df2a tempest-CreateVolumesFromImageTest-1012361810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2fb9c042-ac1a-49cd-97e7-8d93b42ecfe3" returned: 0 in 0.441s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e6013a3c-8284-40cc-92bd-78b72ad9df2a tempest-CreateVolumesFromImageTest-1012361810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2fb9c042-ac1a-49cd-97e7-8d93b42ecfe3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:46 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2fb9c042-ac1a-49cd-97e7-8d93b42ecfe3 Nov 03 08:32:46 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:46 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e6013a3c-8284-40cc-92bd-78b72ad9df2a tempest-CreateVolumesFromImageTest-1012361810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2fb9c042-ac1a-49cd-97e7-8d93b42ecfe3" returned: 0 in 0.290s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:46 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e6013a3c-8284-40cc-92bd-78b72ad9df2a tempest-CreateVolumesFromImageTest-1012361810 None] Lock "cinder-quobyte-2fb9c042-ac1a-49cd-97e7-8d93b42ecfe3" released by "delete_volume" :: held 0.802s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:46 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-e6013a3c-8284-40cc-92bd-78b72ad9df2a tempest-CreateVolumesFromImageTest-1012361810 None] Created reservations ['c2d8f595-62ea-4d80-86d4-d20daa19ce37', '18a3f1c9-2b13-42f5-a4ca-8817b5ec89c3', '02bee33d-cd0c-4b0d-9aa2-392acc8a0024', '9b4195b6-8e61-40f3-afaf-88e1b7f80ec5'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:32:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e6013a3c-8284-40cc-92bd-78b72ad9df2a tempest-CreateVolumesFromImageTest-1012361810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e6013a3c-8284-40cc-92bd-78b72ad9df2a tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e6013a3c-8284-40cc-92bd-78b72ad9df2a tempest-CreateVolumesFromImageTest-1012361810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e6013a3c-8284-40cc-92bd-78b72ad9df2a tempest-CreateVolumesFromImageTest-1012361810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e6013a3c-8284-40cc-92bd-78b72ad9df2a tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e6013a3c-8284-40cc-92bd-78b72ad9df2a tempest-CreateVolumesFromImageTest-1012361810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:47 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:32:47 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-57445a70-bd6d-4ce7-b656-e14b3101fa90 tempest-CreateVolumesFromImageTest-1012361810 None] Acquiring lock "cinder-7ff425ab-4529-4fa0-a32f-f7bf5ba81b2a-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-57445a70-bd6d-4ce7-b656-e14b3101fa90 tempest-CreateVolumesFromImageTest-1012361810 None] Lock "cinder-7ff425ab-4529-4fa0-a32f-f7bf5ba81b2a-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-57445a70-bd6d-4ce7-b656-e14b3101fa90 tempest-CreateVolumesFromImageTest-1012361810 None] Acquiring lock "cinder-quobyte-7ff425ab-4529-4fa0-a32f-f7bf5ba81b2a" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-57445a70-bd6d-4ce7-b656-e14b3101fa90 tempest-CreateVolumesFromImageTest-1012361810 None] Lock "cinder-quobyte-7ff425ab-4529-4fa0-a32f-f7bf5ba81b2a" acquired by "delete_volume" :: waited 0.034s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:47 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6a16c9-032b-4bf7-a280-c2845b731bd6]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-57445a70-bd6d-4ce7-b656-e14b3101fa90 tempest-CreateVolumesFromImageTest-1012361810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ff425ab-4529-4fa0-a32f-f7bf5ba81b2a {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:47 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e6013a3c-8284-40cc-92bd-78b72ad9df2a tempest-CreateVolumesFromImageTest-1012361810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.383s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:47 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-e6013a3c-8284-40cc-92bd-78b72ad9df2a tempest-CreateVolumesFromImageTest-1012361810 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:32:47 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-e6013a3c-8284-40cc-92bd-78b72ad9df2a tempest-CreateVolumesFromImageTest-1012361810 None] Deleted volume successfully. Nov 03 08:32:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e6013a3c-8284-40cc-92bd-78b72ad9df2a tempest-CreateVolumesFromImageTest-1012361810 None] Lock "cinder-2fb9c042-ac1a-49cd-97e7-8d93b42ecfe3-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:47 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ff425ab-4529-4fa0-a32f-f7bf5ba81b2a Nov 03 08:32:47 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:47 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-57445a70-bd6d-4ce7-b656-e14b3101fa90 tempest-CreateVolumesFromImageTest-1012361810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ff425ab-4529-4fa0-a32f-f7bf5ba81b2a" returned: 0 in 0.532s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-57445a70-bd6d-4ce7-b656-e14b3101fa90 tempest-CreateVolumesFromImageTest-1012361810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ff425ab-4529-4fa0-a32f-f7bf5ba81b2a {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:47 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ff425ab-4529-4fa0-a32f-f7bf5ba81b2a Nov 03 08:32:47 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:47 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Flow 'volume_create_manager' (d7a9d250-2ea6-431b-90a9-ba0b81b9645e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9376773f-10d9-43a4-a60a-953f409f862a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9376773f-10d9-43a4-a60a-953f409f862a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1348363485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=644e5e25-f20f-459b-9be2-d322db3c90e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0e3a49275d4e1b8a86d8254cb779b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a5b9b95a-9ae3-4075-8821-e31cf8e59922,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:48Z,use_quota=True,user_id='d3bacc1a887443c8a27195fd05f4f57d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab6a1de-4429-4d42-82f6-c700d7585379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab6a1de-4429-4d42-82f6-c700d7585379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff4cc89-cc99-47a5-92bf-29de04693351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff4cc89-cc99-47a5-92bf-29de04693351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '644e5e25-f20f-459b-9be2-d322db3c90e9', 'volume_name': 'volume-644e5e25-f20f-459b-9be2-d322db3c90e9', 'volume_size': 1, 'snapshot_id': 'a5b9b95a-9ae3-4075-8821-e31cf8e59922'}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a1ac12-9cdb-4635-a537-e20180492caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a1ac12-9cdb-4635-a537-e20180492caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aaaaa51-4f26-4d57-962f-c4c0dc6af3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:48 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Volume 644e5e25-f20f-459b-9be2-d322db3c90e9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-644e5e25-f20f-459b-9be2-d322db3c90e9', 'volume_size': 1, 'snapshot_id': 'a5b9b95a-9ae3-4075-8821-e31cf8e59922'} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Acquiring lock "cinder-quobyte-a5b9b95a-9ae3-4075-8821-e31cf8e59922-644e5e25-f20f-459b-9be2-d322db3c90e9" by "_create_volume_from_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Lock "cinder-quobyte-a5b9b95a-9ae3-4075-8821-e31cf8e59922-644e5e25-f20f-459b-9be2-d322db3c90e9" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Creating volume 644e5e25-f20f-459b-9be2-d322db3c90e9 from snapshot a5b9b95a-9ae3-4075-8821-e31cf8e59922 {{(pid=86801) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Acquiring lock "cinder-quobyte-644e5e25-f20f-459b-9be2-d322db3c90e9" by "_copy_volume_from_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Lock "cinder-quobyte-644e5e25-f20f-459b-9be2-d322db3c90e9" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] snapshot: a5b9b95a-9ae3-4075-8821-e31cf8e59922, volume: 644e5e25-f20f-459b-9be2-d322db3c90e9, {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 08:32:48 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-57445a70-bd6d-4ce7-b656-e14b3101fa90 tempest-CreateVolumesFromImageTest-1012361810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-7ff425ab-4529-4fa0-a32f-f7bf5ba81b2a" returned: 0 in 0.383s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab89d0c6-10ff-47f7-aabd-9c03c653c995]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-57445a70-bd6d-4ce7-b656-e14b3101fa90 tempest-CreateVolumesFromImageTest-1012361810 None] Lock "cinder-quobyte-7ff425ab-4529-4fa0-a32f-f7bf5ba81b2a" released by "delete_volume" :: held 0.999s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.a5b9b95a-9ae3-4075-8821-e31cf8e59922 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-57445a70-bd6d-4ce7-b656-e14b3101fa90 tempest-CreateVolumesFromImageTest-1012361810 None] Created reservations ['9edc9c95-0eda-4ca9-ab4d-665845cab0e9', '9f969bdd-e3f0-425a-bec6-6eaa4618c1b0', '5f91acf4-c40a-436b-89de-f6385c460ab1', '6b86e941-59df-4272-bdc4-178fbcaf8669'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-57445a70-bd6d-4ce7-b656-e14b3101fa90 tempest-CreateVolumesFromImageTest-1012361810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-57445a70-bd6d-4ce7-b656-e14b3101fa90 tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-57445a70-bd6d-4ce7-b656-e14b3101fa90 tempest-CreateVolumesFromImageTest-1012361810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-57445a70-bd6d-4ce7-b656-e14b3101fa90 tempest-CreateVolumesFromImageTest-1012361810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-57445a70-bd6d-4ce7-b656-e14b3101fa90 tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-57445a70-bd6d-4ce7-b656-e14b3101fa90 tempest-CreateVolumesFromImageTest-1012361810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:48 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.a5b9b95a-9ae3-4075-8821-e31cf8e59922 Nov 03 08:32:48 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:48 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:32:48 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:48 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-57445a70-bd6d-4ce7-b656-e14b3101fa90 tempest-CreateVolumesFromImageTest-1012361810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.295s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-57445a70-bd6d-4ce7-b656-e14b3101fa90 tempest-CreateVolumesFromImageTest-1012361810 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:32:48 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-57445a70-bd6d-4ce7-b656-e14b3101fa90 tempest-CreateVolumesFromImageTest-1012361810 None] Deleted volume successfully. Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-57445a70-bd6d-4ce7-b656-e14b3101fa90 tempest-CreateVolumesFromImageTest-1012361810 None] Lock "cinder-7ff425ab-4529-4fa0-a32f-f7bf5ba81b2a-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:48 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.a5b9b95a-9ae3-4075-8821-e31cf8e59922" returned: 0 in 0.498s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45debfb3-9900-4324-85b8-7baeee85c55d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[48258124-11e1-4d76-875a-ead796b86db1]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:48 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d Nov 03 08:32:48 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:49 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d" returned: 0 in 0.440s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:49 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 08:32:49 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Creating direct copy from snapshot {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 08:32:49 devstack cinder-volume[86801]: DEBUG cinder.utils [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Path /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-644e5e25-f20f-459b-9be2-d322db3c90e9 not found in is_blk_device check {{(pid=86801) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 08:32:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-644e5e25-f20f-459b-9be2-d322db3c90e9 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:49 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-644e5e25-f20f-459b-9be2-d322db3c90e9 Nov 03 08:32:49 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:49 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6f0eae06-7f94-42aa-91f0-b36aaf85dc6e tempest-CreateVolumesFromImageTest-1012361810 None] Acquiring lock "cinder-0ab901d7-4824-4809-a683-8a3525a31dce-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:49 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6f0eae06-7f94-42aa-91f0-b36aaf85dc6e tempest-CreateVolumesFromImageTest-1012361810 None] Lock "cinder-0ab901d7-4824-4809-a683-8a3525a31dce-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:49 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6f0eae06-7f94-42aa-91f0-b36aaf85dc6e tempest-CreateVolumesFromImageTest-1012361810 None] Acquiring lock "cinder-quobyte-0ab901d7-4824-4809-a683-8a3525a31dce" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:49 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6f0eae06-7f94-42aa-91f0-b36aaf85dc6e tempest-CreateVolumesFromImageTest-1012361810 None] Lock "cinder-quobyte-0ab901d7-4824-4809-a683-8a3525a31dce" acquired by "delete_volume" :: waited 0.020s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:49 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47ac2df-97fa-465b-a739-4e3e1c930b09]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6f0eae06-7f94-42aa-91f0-b36aaf85dc6e tempest-CreateVolumesFromImageTest-1012361810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0ab901d7-4824-4809-a683-8a3525a31dce {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:49 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0ab901d7-4824-4809-a683-8a3525a31dce Nov 03 08:32:49 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:50 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6f0eae06-7f94-42aa-91f0-b36aaf85dc6e tempest-CreateVolumesFromImageTest-1012361810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0ab901d7-4824-4809-a683-8a3525a31dce" returned: 0 in 0.701s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6f0eae06-7f94-42aa-91f0-b36aaf85dc6e tempest-CreateVolumesFromImageTest-1012361810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0ab901d7-4824-4809-a683-8a3525a31dce {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:50 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0ab901d7-4824-4809-a683-8a3525a31dce Nov 03 08:32:50 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:50 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6f0eae06-7f94-42aa-91f0-b36aaf85dc6e tempest-CreateVolumesFromImageTest-1012361810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-0ab901d7-4824-4809-a683-8a3525a31dce" returned: 0 in 0.577s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:50 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6f0eae06-7f94-42aa-91f0-b36aaf85dc6e tempest-CreateVolumesFromImageTest-1012361810 None] Lock "cinder-quobyte-0ab901d7-4824-4809-a683-8a3525a31dce" released by "delete_volume" :: held 1.372s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:51 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-6f0eae06-7f94-42aa-91f0-b36aaf85dc6e tempest-CreateVolumesFromImageTest-1012361810 None] Created reservations ['ee5c42d2-a58b-4f35-9557-790b738996cf', 'b0f4c55a-52d1-470c-8e12-f65080618cfa', 'f3d590c9-d86a-45d1-9606-5ad703cbc498', 'a11483db-48d5-4ad9-8b6f-9f5e6efa7a15'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:32:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6f0eae06-7f94-42aa-91f0-b36aaf85dc6e tempest-CreateVolumesFromImageTest-1012361810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6f0eae06-7f94-42aa-91f0-b36aaf85dc6e tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:51 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6f0eae06-7f94-42aa-91f0-b36aaf85dc6e tempest-CreateVolumesFromImageTest-1012361810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:51 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6f0eae06-7f94-42aa-91f0-b36aaf85dc6e tempest-CreateVolumesFromImageTest-1012361810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6f0eae06-7f94-42aa-91f0-b36aaf85dc6e tempest-CreateVolumesFromImageTest-1012361810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6f0eae06-7f94-42aa-91f0-b36aaf85dc6e tempest-CreateVolumesFromImageTest-1012361810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:51 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:32:51 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:51 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6f0eae06-7f94-42aa-91f0-b36aaf85dc6e tempest-CreateVolumesFromImageTest-1012361810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.552s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:51 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-6f0eae06-7f94-42aa-91f0-b36aaf85dc6e tempest-CreateVolumesFromImageTest-1012361810 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:32:51 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-6f0eae06-7f94-42aa-91f0-b36aaf85dc6e tempest-CreateVolumesFromImageTest-1012361810 None] Deleted volume successfully. Nov 03 08:32:51 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6f0eae06-7f94-42aa-91f0-b36aaf85dc6e tempest-CreateVolumesFromImageTest-1012361810 None] Lock "cinder-0ab901d7-4824-4809-a683-8a3525a31dce-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:52 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:32:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Flow 'volume_create_manager' (2a179751-5632-426d-8bc2-b2f8ad21fa97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18cd2c63-3b6a-43ed-9a8d-ddb4f8fdabe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18cd2c63-3b6a-43ed-9a8d-ddb4f8fdabe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-340718626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceee7705-f29d-4f71-9637-28cfa9e95e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8a8eb49c1b4829ae457fc94e4a2579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:52Z,use_quota=True,user_id='1d4001dc5c6a4c49afc6ca5d970aae8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9428a2dc-1c07-4699-9092-daf67752e5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9428a2dc-1c07-4699-9092-daf67752e5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2608bd2-8297-4b1b-8a28-90aa156eb1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2608bd2-8297-4b1b-8a28-90aa156eb1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceee7705-f29d-4f71-9637-28cfa9e95e4e', 'volume_name': 'volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c3b8826-5efe-4f86-a451-7945ff77ec46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c3b8826-5efe-4f86-a451-7945ff77ec46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba7b819a-be87-419e-a10a-f7d53c75d09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:52 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Volume ceee7705-f29d-4f71-9637-28cfa9e95e4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e', 'volume_size': 1} Nov 03 08:32:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:57 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-644e5e25-f20f-459b-9be2-d322db3c90e9" returned: 0 in 8.641s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:57 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d, size 1024.00 MB, duration 8.64 sec, destination /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-644e5e25-f20f-459b-9be2-d322db3c90e9 {{(pid=86801) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 08:32:57 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Converted 1024.00 MB image at 118.49 MB/s Nov 03 08:32:57 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-644e5e25-f20f-459b-9be2-d322db3c90e9 is being set with open permissions: ugo+rw Nov 03 08:32:57 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-644e5e25-f20f-459b-9be2-d322db3c90e9 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:57 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-644e5e25-f20f-459b-9be2-d322db3c90e9 Nov 03 08:32:57 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:58 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-644e5e25-f20f-459b-9be2-d322db3c90e9" returned: 0 in 0.272s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:58 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Lock "cinder-quobyte-644e5e25-f20f-459b-9be2-d322db3c90e9" released by "_copy_volume_from_snapshot" :: held 9.989s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:58 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Lock "cinder-quobyte-a5b9b95a-9ae3-4075-8821-e31cf8e59922-644e5e25-f20f-459b-9be2-d322db3c90e9" released by "_create_volume_from_snapshot" :: held 10.067s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:32:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.092s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.522s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:58 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-340718626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceee7705-f29d-4f71-9637-28cfa9e95e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8a8eb49c1b4829ae457fc94e4a2579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:32:52Z,use_quota=True,user_id='1d4001dc5c6a4c49afc6ca5d970aae8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:32:58 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Creating volume ceee7705-f29d-4f71-9637-28cfa9e95e4e {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:32:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:32:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:32:58 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:32:58 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:32:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:58 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:32:58 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:32:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:58 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e 1073741824 Nov 03 08:32:58 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:58 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aaaaa51-4f26-4d57-962f-c4c0dc6af3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-644e5e25-f20f-459b-9be2-d322db3c90e9', 'volume_size': 1, 'snapshot_id': 'a5b9b95a-9ae3-4075-8821-e31cf8e59922'}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:58 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (194604ef-2e58-4759-874f-d233f8adb268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:58 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Volume volume-644e5e25-f20f-459b-9be2-d322db3c90e9 (644e5e25-f20f-459b-9be2-d322db3c90e9): created successfully Nov 03 08:32:58 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (194604ef-2e58-4759-874f-d233f8adb268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:58 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Flow 'volume_create_manager' (d7a9d250-2ea6-431b-90a9-ba0b81b9645e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:58 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-71a1dbfd-5b4f-4ce7-ae8a-09195f779577 tempest-VolumeDependencyTests-1192107025 None] Created volume successfully. Nov 03 08:32:58 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-27f4a590-69e9-4e59-a141-da53bce0ed5d tempest-ProjectAdminTests-1735760194 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6987686157227, 'free_capacity_gb': 1773.6987686157227, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86801) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 08:32:58 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e 1073741824" returned: 0 in 0.553s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:58 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:58 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e Nov 03 08:32:58 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:59 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e" returned: 0 in 0.289s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:59 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:32:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:32:59 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba7b819a-be87-419e-a10a-f7d53c75d09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:59 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b9cc58a-1e74-4346-a1c4-ce5045aed565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:32:59 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Volume volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e (ceee7705-f29d-4f71-9637-28cfa9e95e4e): created successfully Nov 03 08:32:59 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b9cc58a-1e74-4346-a1c4-ce5045aed565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:32:59 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Flow 'volume_create_manager' (2a179751-5632-426d-8bc2-b2f8ad21fa97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:32:59 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-b2739d2a-a4c8-47c1-a2f8-c8f6655016e9 tempest-ProjectReaderTests-1056302893 None] Created volume successfully. Nov 03 08:32:59 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8aaad9bd-52fa-4884-b45e-65a09ef6973e tempest-VolumeDependencyTests-1192107025 None] Acquiring lock "cinder-a5b9b95a-9ae3-4075-8821-e31cf8e59922-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:59 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8aaad9bd-52fa-4884-b45e-65a09ef6973e tempest-VolumeDependencyTests-1192107025 None] Lock "cinder-a5b9b95a-9ae3-4075-8821-e31cf8e59922-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:59 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8aaad9bd-52fa-4884-b45e-65a09ef6973e tempest-VolumeDependencyTests-1192107025 None] Acquiring lock "cinder-quobyte-45debfb3-9900-4324-85b8-7baeee85c55d" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:59 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8aaad9bd-52fa-4884-b45e-65a09ef6973e tempest-VolumeDependencyTests-1192107025 None] Lock "cinder-quobyte-45debfb3-9900-4324-85b8-7baeee85c55d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:59 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8aaad9bd-52fa-4884-b45e-65a09ef6973e tempest-VolumeDependencyTests-1192107025 None] Acquiring lock "cinder-quobyte-a5b9b95a-9ae3-4075-8821-e31cf8e59922" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:32:59 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8aaad9bd-52fa-4884-b45e-65a09ef6973e tempest-VolumeDependencyTests-1192107025 None] Lock "cinder-quobyte-a5b9b95a-9ae3-4075-8821-e31cf8e59922" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:32:59 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-8aaad9bd-52fa-4884-b45e-65a09ef6973e tempest-VolumeDependencyTests-1192107025 None] Deleting offline snapshot a5b9b95a-9ae3-4075-8821-e31cf8e59922 of volume 45debfb3-9900-4324-85b8-7baeee85c55d {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:32:59 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-8aaad9bd-52fa-4884-b45e-65a09ef6973e tempest-VolumeDependencyTests-1192107025 None] snapshot_file for this snap is: volume-45debfb3-9900-4324-85b8-7baeee85c55d.a5b9b95a-9ae3-4075-8821-e31cf8e59922 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:32:59 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffa8d57-11c8-4847-8bdb-3969ec3b3a43]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8aaad9bd-52fa-4884-b45e-65a09ef6973e tempest-VolumeDependencyTests-1192107025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.a5b9b95a-9ae3-4075-8821-e31cf8e59922 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:32:59 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.a5b9b95a-9ae3-4075-8821-e31cf8e59922 Nov 03 08:32:59 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:32:59 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Nov 03 08:32:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8aaad9bd-52fa-4884-b45e-65a09ef6973e tempest-VolumeDependencyTests-1192107025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.a5b9b95a-9ae3-4075-8821-e31cf8e59922" returned: 0 in 0.418s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:32:59 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-8aaad9bd-52fa-4884-b45e-65a09ef6973e tempest-VolumeDependencyTests-1192107025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45debfb3-9900-4324-85b8-7baeee85c55d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:32:59 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[4034cf4b-669f-4062-a6d9-35930288df67]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:32:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8aaad9bd-52fa-4884-b45e-65a09ef6973e tempest-VolumeDependencyTests-1192107025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:00 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d Nov 03 08:33:00 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-60754440-308d-4796-bdaa-167694cfec4b tempest-ProjectReaderTests-1056302893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-60754440-308d-4796-bdaa-167694cfec4b tempest-ProjectReaderTests-1056302893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-60754440-308d-4796-bdaa-167694cfec4b tempest-ProjectReaderTests-1056302893 None] Creating offline snapshot da276634-9dd2-4efa-878e-bae32384bd90 of volume ceee7705-f29d-4f71-9637-28cfa9e95e4e {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:33:00 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f7bd7e-1651-4181-9963-29bca604ff91]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-60754440-308d-4796-bdaa-167694cfec4b tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:00 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e Nov 03 08:33:00 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:00 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8aaad9bd-52fa-4884-b45e-65a09ef6973e tempest-VolumeDependencyTests-1192107025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d" returned: 0 in 0.705s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8aaad9bd-52fa-4884-b45e-65a09ef6973e tempest-VolumeDependencyTests-1192107025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.a5b9b95a-9ae3-4075-8821-e31cf8e59922 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:00 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.a5b9b95a-9ae3-4075-8821-e31cf8e59922 Nov 03 08:33:00 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:00 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-60754440-308d-4796-bdaa-167694cfec4b tempest-ProjectReaderTests-1056302893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e" returned: 0 in 0.474s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-60754440-308d-4796-bdaa-167694cfec4b tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e.da276634-9dd2-4efa-878e-bae32384bd90 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:00 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e.da276634-9dd2-4efa-878e-bae32384bd90 1G Nov 03 08:33:00 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:01 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8aaad9bd-52fa-4884-b45e-65a09ef6973e tempest-VolumeDependencyTests-1192107025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.a5b9b95a-9ae3-4075-8821-e31cf8e59922" returned: 0 in 0.409s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8aaad9bd-52fa-4884-b45e-65a09ef6973e tempest-VolumeDependencyTests-1192107025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.a5b9b95a-9ae3-4075-8821-e31cf8e59922 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:01 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.a5b9b95a-9ae3-4075-8821-e31cf8e59922 Nov 03 08:33:01 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:01 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-60754440-308d-4796-bdaa-167694cfec4b tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e.da276634-9dd2-4efa-878e-bae32384bd90 1G" returned: 0 in 0.554s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-60754440-308d-4796-bdaa-167694cfec4b tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e.da276634-9dd2-4efa-878e-bae32384bd90 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:01 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8aaad9bd-52fa-4884-b45e-65a09ef6973e tempest-VolumeDependencyTests-1192107025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d.a5b9b95a-9ae3-4075-8821-e31cf8e59922" returned: 0 in 0.371s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:01 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e.da276634-9dd2-4efa-878e-bae32384bd90 Nov 03 08:33:01 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8aaad9bd-52fa-4884-b45e-65a09ef6973e tempest-VolumeDependencyTests-1192107025 None] Lock "cinder-quobyte-a5b9b95a-9ae3-4075-8821-e31cf8e59922" released by "_delete_snapshot" :: held 2.080s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8aaad9bd-52fa-4884-b45e-65a09ef6973e tempest-VolumeDependencyTests-1192107025 None] Lock "cinder-quobyte-45debfb3-9900-4324-85b8-7baeee85c55d" released by "delete_snapshot" :: held 2.118s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:01 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-8aaad9bd-52fa-4884-b45e-65a09ef6973e tempest-VolumeDependencyTests-1192107025 None] Created reservations ['48a2d572-a6f4-45ba-89a4-609c7ca50f4a', '782f0bb7-6630-463e-a50e-ed66f53f416b', '1c0c4dd2-9f79-4cf3-b681-5a66a75f14a6', '276c3994-59e5-417e-9b76-3b156ef2cbe2'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:33:01 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-8aaad9bd-52fa-4884-b45e-65a09ef6973e tempest-VolumeDependencyTests-1192107025 None] Delete snapshot completed successfully. Nov 03 08:33:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-8aaad9bd-52fa-4884-b45e-65a09ef6973e tempest-VolumeDependencyTests-1192107025 None] Lock "cinder-a5b9b95a-9ae3-4075-8821-e31cf8e59922-delete_snapshot" released by "delete_snapshot" :: held 2.293s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:01 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-60754440-308d-4796-bdaa-167694cfec4b tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e.da276634-9dd2-4efa-878e-bae32384bd90" returned: 0 in 0.363s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:01 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-60754440-308d-4796-bdaa-167694cfec4b tempest-ProjectReaderTests-1056302893 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e.da276634-9dd2-4efa-878e-bae32384bd90 is being set with open permissions: ugo+rw Nov 03 08:33:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-60754440-308d-4796-bdaa-167694cfec4b tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e.da276634-9dd2-4efa-878e-bae32384bd90 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:01 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e.da276634-9dd2-4efa-878e-bae32384bd90 Nov 03 08:33:01 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:01 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-60754440-308d-4796-bdaa-167694cfec4b tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e.da276634-9dd2-4efa-878e-bae32384bd90" returned: 0 in 0.253s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-60754440-308d-4796-bdaa-167694cfec4b tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:02 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e.info Nov 03 08:33:02 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:02 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-60754440-308d-4796-bdaa-167694cfec4b tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e.info" returned: 0 in 0.339s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:02 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-60754440-308d-4796-bdaa-167694cfec4b tempest-ProjectReaderTests-1056302893 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e.info is being set with open permissions: ugo+rw Nov 03 08:33:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-60754440-308d-4796-bdaa-167694cfec4b tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:02 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e.info Nov 03 08:33:02 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:02 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e8a67c39-2f11-4632-9873-4052d3a21f79 tempest-VolumeDependencyTests-1192107025 None] Acquiring lock "cinder-45debfb3-9900-4324-85b8-7baeee85c55d-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:02 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e8a67c39-2f11-4632-9873-4052d3a21f79 tempest-VolumeDependencyTests-1192107025 None] Lock "cinder-45debfb3-9900-4324-85b8-7baeee85c55d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:02 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e8a67c39-2f11-4632-9873-4052d3a21f79 tempest-VolumeDependencyTests-1192107025 None] Acquiring lock "cinder-quobyte-45debfb3-9900-4324-85b8-7baeee85c55d" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:02 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e8a67c39-2f11-4632-9873-4052d3a21f79 tempest-VolumeDependencyTests-1192107025 None] Lock "cinder-quobyte-45debfb3-9900-4324-85b8-7baeee85c55d" acquired by "delete_volume" :: waited 0.027s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:02 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-60754440-308d-4796-bdaa-167694cfec4b tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e.info" returned: 0 in 0.405s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-60754440-308d-4796-bdaa-167694cfec4b tempest-ProjectReaderTests-1056302893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.503s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:02 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30ea897-ea90-47ca-963e-d5ea2bb6fc10]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e8a67c39-2f11-4632-9873-4052d3a21f79 tempest-VolumeDependencyTests-1192107025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:02 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-60754440-308d-4796-bdaa-167694cfec4b tempest-ProjectReaderTests-1056302893 None] Create snapshot completed successfully Nov 03 08:33:02 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d Nov 03 08:33:02 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:03 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e8a67c39-2f11-4632-9873-4052d3a21f79 tempest-VolumeDependencyTests-1192107025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d" returned: 0 in 0.435s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e8a67c39-2f11-4632-9873-4052d3a21f79 tempest-VolumeDependencyTests-1192107025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:03 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d Nov 03 08:33:03 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:03 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e8a67c39-2f11-4632-9873-4052d3a21f79 tempest-VolumeDependencyTests-1192107025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-45debfb3-9900-4324-85b8-7baeee85c55d" returned: 0 in 0.292s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e8a67c39-2f11-4632-9873-4052d3a21f79 tempest-VolumeDependencyTests-1192107025 None] Lock "cinder-quobyte-45debfb3-9900-4324-85b8-7baeee85c55d" released by "delete_volume" :: held 0.824s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:03 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-e8a67c39-2f11-4632-9873-4052d3a21f79 tempest-VolumeDependencyTests-1192107025 None] Created reservations ['d18017de-0411-46ff-8e9b-d7c9f7a833e0', 'bcbfb9a4-f6a4-4f96-aa68-d1df06ad2d50', '539beb93-d10e-4777-a55c-d1a8e479a848', '688b48a8-734e-40fa-adcb-cdee0505199c'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:33:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e8a67c39-2f11-4632-9873-4052d3a21f79 tempest-VolumeDependencyTests-1192107025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e8a67c39-2f11-4632-9873-4052d3a21f79 tempest-VolumeDependencyTests-1192107025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e8a67c39-2f11-4632-9873-4052d3a21f79 tempest-VolumeDependencyTests-1192107025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e8a67c39-2f11-4632-9873-4052d3a21f79 tempest-VolumeDependencyTests-1192107025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e8a67c39-2f11-4632-9873-4052d3a21f79 tempest-VolumeDependencyTests-1192107025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e8a67c39-2f11-4632-9873-4052d3a21f79 tempest-VolumeDependencyTests-1192107025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:03 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:33:03 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:03 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:33:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-91b485d5-302d-46a1-bee4-9149287cbec9 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "cinder-da276634-9dd2-4efa-878e-bae32384bd90-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:03 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:33:03 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-91b485d5-302d-46a1-bee4-9149287cbec9 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-da276634-9dd2-4efa-878e-bae32384bd90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-91b485d5-302d-46a1-bee4-9149287cbec9 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "cinder-quobyte-ceee7705-f29d-4f71-9637-28cfa9e95e4e" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-91b485d5-302d-46a1-bee4-9149287cbec9 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-ceee7705-f29d-4f71-9637-28cfa9e95e4e" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-91b485d5-302d-46a1-bee4-9149287cbec9 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "cinder-quobyte-da276634-9dd2-4efa-878e-bae32384bd90" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-24e441eb-5611-4030-9f9e-42aca8439f53 tempest-VolumeDependencyTests-1192107025 None] Acquiring lock "cinder-644e5e25-f20f-459b-9be2-d322db3c90e9-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-91b485d5-302d-46a1-bee4-9149287cbec9 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-da276634-9dd2-4efa-878e-bae32384bd90" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-91b485d5-302d-46a1-bee4-9149287cbec9 tempest-ProjectReaderTests-1056302893 None] Deleting offline snapshot da276634-9dd2-4efa-878e-bae32384bd90 of volume ceee7705-f29d-4f71-9637-28cfa9e95e4e {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:33:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-91b485d5-302d-46a1-bee4-9149287cbec9 tempest-ProjectReaderTests-1056302893 None] snapshot_file for this snap is: volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e.da276634-9dd2-4efa-878e-bae32384bd90 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:33:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-24e441eb-5611-4030-9f9e-42aca8439f53 tempest-VolumeDependencyTests-1192107025 None] Lock "cinder-644e5e25-f20f-459b-9be2-d322db3c90e9-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:04 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[131b6592-5923-42ec-9056-f127fc4bb56f]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-91b485d5-302d-46a1-bee4-9149287cbec9 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e.da276634-9dd2-4efa-878e-bae32384bd90 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:04 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e8a67c39-2f11-4632-9873-4052d3a21f79 tempest-VolumeDependencyTests-1192107025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.348s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:04 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-e8a67c39-2f11-4632-9873-4052d3a21f79 tempest-VolumeDependencyTests-1192107025 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:33:04 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e.da276634-9dd2-4efa-878e-bae32384bd90 Nov 03 08:33:04 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:04 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-e8a67c39-2f11-4632-9873-4052d3a21f79 tempest-VolumeDependencyTests-1192107025 None] Deleted volume successfully. Nov 03 08:33:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-24e441eb-5611-4030-9f9e-42aca8439f53 tempest-VolumeDependencyTests-1192107025 None] Acquiring lock "cinder-quobyte-644e5e25-f20f-459b-9be2-d322db3c90e9" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-e8a67c39-2f11-4632-9873-4052d3a21f79 tempest-VolumeDependencyTests-1192107025 None] Lock "cinder-45debfb3-9900-4324-85b8-7baeee85c55d-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-24e441eb-5611-4030-9f9e-42aca8439f53 tempest-VolumeDependencyTests-1192107025 None] Lock "cinder-quobyte-644e5e25-f20f-459b-9be2-d322db3c90e9" acquired by "delete_volume" :: waited 0.041s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:04 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71af1a0-ea13-4c41-b3b6-9b9e24b9bd4e]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-24e441eb-5611-4030-9f9e-42aca8439f53 tempest-VolumeDependencyTests-1192107025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-644e5e25-f20f-459b-9be2-d322db3c90e9 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:04 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.506s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:04 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:33:04 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager._thread_info {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:33:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread count: 29 {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 08:33:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread info: [<_MainThread(MainThread, started 139707544170624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 08:33:04 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-644e5e25-f20f-459b-9be2-d322db3c90e9 Nov 03 08:33:04 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:04 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-91b485d5-302d-46a1-bee4-9149287cbec9 tempest-ProjectReaderTests-1056302893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e.da276634-9dd2-4efa-878e-bae32384bd90" returned: 0 in 0.482s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-91b485d5-302d-46a1-bee4-9149287cbec9 tempest-ProjectReaderTests-1056302893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:33:04 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea77d92-757f-46e4-bfa2-e425f7a430b4]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-91b485d5-302d-46a1-bee4-9149287cbec9 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:04 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e Nov 03 08:33:04 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:04 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-24e441eb-5611-4030-9f9e-42aca8439f53 tempest-VolumeDependencyTests-1192107025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-644e5e25-f20f-459b-9be2-d322db3c90e9" returned: 0 in 0.505s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-24e441eb-5611-4030-9f9e-42aca8439f53 tempest-VolumeDependencyTests-1192107025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-644e5e25-f20f-459b-9be2-d322db3c90e9 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:04 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-644e5e25-f20f-459b-9be2-d322db3c90e9 Nov 03 08:33:04 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:04 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-91b485d5-302d-46a1-bee4-9149287cbec9 tempest-ProjectReaderTests-1056302893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e" returned: 0 in 0.464s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-91b485d5-302d-46a1-bee4-9149287cbec9 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e.da276634-9dd2-4efa-878e-bae32384bd90 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:05 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e.da276634-9dd2-4efa-878e-bae32384bd90 Nov 03 08:33:05 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:05 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-24e441eb-5611-4030-9f9e-42aca8439f53 tempest-VolumeDependencyTests-1192107025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-644e5e25-f20f-459b-9be2-d322db3c90e9" returned: 0 in 0.347s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-24e441eb-5611-4030-9f9e-42aca8439f53 tempest-VolumeDependencyTests-1192107025 None] Lock "cinder-quobyte-644e5e25-f20f-459b-9be2-d322db3c90e9" released by "delete_volume" :: held 0.919s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-24e441eb-5611-4030-9f9e-42aca8439f53 tempest-VolumeDependencyTests-1192107025 None] Created reservations ['eac1e37c-ff83-4710-a6a0-bfdd18afbd38', '4f92e489-9cdd-4209-804a-d906fe76bb2e', 'f517a05b-8f4f-4bb9-bb77-08d51ec66f9b', 'a64a6779-8013-441a-89b6-99d6e81fa04d'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-24e441eb-5611-4030-9f9e-42aca8439f53 tempest-VolumeDependencyTests-1192107025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-24e441eb-5611-4030-9f9e-42aca8439f53 tempest-VolumeDependencyTests-1192107025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-24e441eb-5611-4030-9f9e-42aca8439f53 tempest-VolumeDependencyTests-1192107025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-24e441eb-5611-4030-9f9e-42aca8439f53 tempest-VolumeDependencyTests-1192107025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-24e441eb-5611-4030-9f9e-42aca8439f53 tempest-VolumeDependencyTests-1192107025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-24e441eb-5611-4030-9f9e-42aca8439f53 tempest-VolumeDependencyTests-1192107025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:05 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:33:05 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:05 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-91b485d5-302d-46a1-bee4-9149287cbec9 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e.da276634-9dd2-4efa-878e-bae32384bd90" returned: 0 in 0.513s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-91b485d5-302d-46a1-bee4-9149287cbec9 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e.da276634-9dd2-4efa-878e-bae32384bd90 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:05 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e.da276634-9dd2-4efa-878e-bae32384bd90 Nov 03 08:33:05 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Flow 'volume_create_manager' (255d91e3-013d-42d4-8a9a-a35c7253c999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af618ea-bf28-4570-9ffa-1ee64a1e18ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af618ea-bf28-4570-9ffa-1ee64a1e18ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1327610737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e9ec2aa-1f4d-44b8-9536-9635700eba28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682c6c6386be454884735db38fc738c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:05Z,use_quota=True,user_id='de4b4cdf24174c26987ef244c8794272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb0e716-22e0-451c-af47-e9a2804bc880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb0e716-22e0-451c-af47-e9a2804bc880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:05 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f484398-9b25-4622-a199-d9ea01cbe974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f484398-9b25-4622-a199-d9ea01cbe974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e9ec2aa-1f4d-44b8-9536-9635700eba28', 'volume_name': 'volume-5e9ec2aa-1f4d-44b8-9536-9635700eba28', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (181ed95e-ed45-4a68-85e9-827b5140728b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (181ed95e-ed45-4a68-85e9-827b5140728b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3929eadc-7845-4faa-bd3d-048a89ca22d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:05 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Volume 5e9ec2aa-1f4d-44b8-9536-9635700eba28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e9ec2aa-1f4d-44b8-9536-9635700eba28', 'volume_size': 1} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1327610737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e9ec2aa-1f4d-44b8-9536-9635700eba28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682c6c6386be454884735db38fc738c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:05Z,use_quota=True,user_id='de4b4cdf24174c26987ef244c8794272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Creating volume 5e9ec2aa-1f4d-44b8-9536-9635700eba28 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:33:05 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5e9ec2aa-1f4d-44b8-9536-9635700eba28 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-24e441eb-5611-4030-9f9e-42aca8439f53 tempest-VolumeDependencyTests-1192107025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.367s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-24e441eb-5611-4030-9f9e-42aca8439f53 tempest-VolumeDependencyTests-1192107025 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:33:05 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-24e441eb-5611-4030-9f9e-42aca8439f53 tempest-VolumeDependencyTests-1192107025 None] Deleted volume successfully. Nov 03 08:33:05 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5e9ec2aa-1f4d-44b8-9536-9635700eba28 1073741824 Nov 03 08:33:05 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-24e441eb-5611-4030-9f9e-42aca8439f53 tempest-VolumeDependencyTests-1192107025 None] Lock "cinder-644e5e25-f20f-459b-9be2-d322db3c90e9-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:05 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-91b485d5-302d-46a1-bee4-9149287cbec9 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e.da276634-9dd2-4efa-878e-bae32384bd90" returned: 0 in 0.330s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-91b485d5-302d-46a1-bee4-9149287cbec9 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-da276634-9dd2-4efa-878e-bae32384bd90" released by "_delete_snapshot" :: held 1.928s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-91b485d5-302d-46a1-bee4-9149287cbec9 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-ceee7705-f29d-4f71-9637-28cfa9e95e4e" released by "delete_snapshot" :: held 1.994s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:05 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-91b485d5-302d-46a1-bee4-9149287cbec9 tempest-ProjectReaderTests-1056302893 None] Created reservations ['596fdac0-2256-40bc-8302-c1e9e9735901', 'daac3b05-0f7f-4111-b9ca-ff8cad38aabb', '30f6f7bb-9076-4616-99d4-4a32bcd9f912', 'c00626e2-715d-4f02-9d3a-ea547953268d'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:33:06 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-91b485d5-302d-46a1-bee4-9149287cbec9 tempest-ProjectReaderTests-1056302893 None] Delete snapshot completed successfully. Nov 03 08:33:06 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-91b485d5-302d-46a1-bee4-9149287cbec9 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-da276634-9dd2-4efa-878e-bae32384bd90-delete_snapshot" released by "delete_snapshot" :: held 2.205s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:06 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5e9ec2aa-1f4d-44b8-9536-9635700eba28 1073741824" returned: 0 in 0.557s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5e9ec2aa-1f4d-44b8-9536-9635700eba28 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:06 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5e9ec2aa-1f4d-44b8-9536-9635700eba28 Nov 03 08:33:06 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:06 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5e9ec2aa-1f4d-44b8-9536-9635700eba28" returned: 0 in 0.277s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:33:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3929eadc-7845-4faa-bd3d-048a89ca22d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e9ec2aa-1f4d-44b8-9536-9635700eba28', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07aae066-f9f4-44e5-b952-f09a4fafa3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:06 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Volume volume-5e9ec2aa-1f4d-44b8-9536-9635700eba28 (5e9ec2aa-1f4d-44b8-9536-9635700eba28): created successfully Nov 03 08:33:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07aae066-f9f4-44e5-b952-f09a4fafa3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:06 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Flow 'volume_create_manager' (255d91e3-013d-42d4-8a9a-a35c7253c999) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:06 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-b4bcc933-fbf8-414f-820f-a0a2848c78ff tempest-ProjectReaderTests-1754000686 None] Created volume successfully. Nov 03 08:33:07 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c010e1f3-9650-4a9c-8c66-cffb6fcf26ed tempest-ProjectReaderTests-1056302893 None] Acquiring lock "cinder-ceee7705-f29d-4f71-9637-28cfa9e95e4e-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:07 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c010e1f3-9650-4a9c-8c66-cffb6fcf26ed tempest-ProjectReaderTests-1056302893 None] Lock "cinder-ceee7705-f29d-4f71-9637-28cfa9e95e4e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:07 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c010e1f3-9650-4a9c-8c66-cffb6fcf26ed tempest-ProjectReaderTests-1056302893 None] Acquiring lock "cinder-quobyte-ceee7705-f29d-4f71-9637-28cfa9e95e4e" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:07 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c010e1f3-9650-4a9c-8c66-cffb6fcf26ed tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-ceee7705-f29d-4f71-9637-28cfa9e95e4e" acquired by "delete_volume" :: waited 0.014s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:07 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[715815f4-27bd-409c-b87c-9804b0194cda]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c010e1f3-9650-4a9c-8c66-cffb6fcf26ed tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:07 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e Nov 03 08:33:07 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:07 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c010e1f3-9650-4a9c-8c66-cffb6fcf26ed tempest-ProjectReaderTests-1056302893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e" returned: 0 in 0.426s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c010e1f3-9650-4a9c-8c66-cffb6fcf26ed tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:07 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e Nov 03 08:33:07 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:07 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4471b2f6-c3f0-484b-9290-770e886de27c tempest-ProjectReaderTests-1754000686 None] Acquiring lock "cinder-5e9ec2aa-1f4d-44b8-9536-9635700eba28-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:07 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4471b2f6-c3f0-484b-9290-770e886de27c tempest-ProjectReaderTests-1754000686 None] Lock "cinder-5e9ec2aa-1f4d-44b8-9536-9635700eba28-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:07 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:UPDATE=295,cinder:SELECT=186,cinder:DELETE=26,cinder:INSERT=76 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:33:07 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=217,cinder:UPDATE=263,cinder:INSERT=66,cinder:DELETE=24 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:33:07 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4471b2f6-c3f0-484b-9290-770e886de27c tempest-ProjectReaderTests-1754000686 None] Acquiring lock "cinder-quobyte-5e9ec2aa-1f4d-44b8-9536-9635700eba28" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:07 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c010e1f3-9650-4a9c-8c66-cffb6fcf26ed tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-ceee7705-f29d-4f71-9637-28cfa9e95e4e" returned: 0 in 0.343s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:07 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4471b2f6-c3f0-484b-9290-770e886de27c tempest-ProjectReaderTests-1754000686 None] Lock "cinder-quobyte-5e9ec2aa-1f4d-44b8-9536-9635700eba28" acquired by "delete_volume" :: waited 0.047s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:08 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c010e1f3-9650-4a9c-8c66-cffb6fcf26ed tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-ceee7705-f29d-4f71-9637-28cfa9e95e4e" released by "delete_volume" :: held 0.881s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:08 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae82f4a-73a8-48dc-9296-7bbc4c18fe54]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4471b2f6-c3f0-484b-9290-770e886de27c tempest-ProjectReaderTests-1754000686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5e9ec2aa-1f4d-44b8-9536-9635700eba28 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:08 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-c010e1f3-9650-4a9c-8c66-cffb6fcf26ed tempest-ProjectReaderTests-1056302893 None] Created reservations ['ec3473e9-7967-4ef3-aeb3-b52481ee673a', 'ffaee8f0-d0e7-44ee-bfff-fd357bd80158', 'f48622ce-b12f-4812-a1a7-30b7b2189fe7', 'e2f114a2-ccaa-49cc-ade3-daf34b124054'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:33:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c010e1f3-9650-4a9c-8c66-cffb6fcf26ed tempest-ProjectReaderTests-1056302893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c010e1f3-9650-4a9c-8c66-cffb6fcf26ed tempest-ProjectReaderTests-1056302893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:08 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c010e1f3-9650-4a9c-8c66-cffb6fcf26ed tempest-ProjectReaderTests-1056302893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:08 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5e9ec2aa-1f4d-44b8-9536-9635700eba28 Nov 03 08:33:08 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:08 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c010e1f3-9650-4a9c-8c66-cffb6fcf26ed tempest-ProjectReaderTests-1056302893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c010e1f3-9650-4a9c-8c66-cffb6fcf26ed tempest-ProjectReaderTests-1056302893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c010e1f3-9650-4a9c-8c66-cffb6fcf26ed tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:08 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:33:08 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:08 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4471b2f6-c3f0-484b-9290-770e886de27c tempest-ProjectReaderTests-1754000686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5e9ec2aa-1f4d-44b8-9536-9635700eba28" returned: 0 in 0.558s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4471b2f6-c3f0-484b-9290-770e886de27c tempest-ProjectReaderTests-1754000686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5e9ec2aa-1f4d-44b8-9536-9635700eba28 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:08 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c010e1f3-9650-4a9c-8c66-cffb6fcf26ed tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.426s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:08 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-c010e1f3-9650-4a9c-8c66-cffb6fcf26ed tempest-ProjectReaderTests-1056302893 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:33:08 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-c010e1f3-9650-4a9c-8c66-cffb6fcf26ed tempest-ProjectReaderTests-1056302893 None] Deleted volume successfully. Nov 03 08:33:08 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5e9ec2aa-1f4d-44b8-9536-9635700eba28 Nov 03 08:33:08 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:08 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c010e1f3-9650-4a9c-8c66-cffb6fcf26ed tempest-ProjectReaderTests-1056302893 None] Lock "cinder-ceee7705-f29d-4f71-9637-28cfa9e95e4e-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:08 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4471b2f6-c3f0-484b-9290-770e886de27c tempest-ProjectReaderTests-1754000686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-5e9ec2aa-1f4d-44b8-9536-9635700eba28" returned: 0 in 0.360s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:08 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4471b2f6-c3f0-484b-9290-770e886de27c tempest-ProjectReaderTests-1754000686 None] Lock "cinder-quobyte-5e9ec2aa-1f4d-44b8-9536-9635700eba28" released by "delete_volume" :: held 0.986s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:08 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Flow 'volume_create_manager' (185963b7-1814-41c4-855e-28903fa18b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (850678a2-61ae-43e8-8605-0c50ded8fae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (850678a2-61ae-43e8-8605-0c50ded8fae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1158469829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=318cea79-5b1b-41df-b862-3fb24bbb34aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8a8eb49c1b4829ae457fc94e4a2579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:09Z,use_quota=True,user_id='1d4001dc5c6a4c49afc6ca5d970aae8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dc2a2fd-4a49-4ab5-a7fc-3eeb4381c241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dc2a2fd-4a49-4ab5-a7fc-3eeb4381c241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7010e84-a999-40e6-844d-ae6012d9c0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7010e84-a999-40e6-844d-ae6012d9c0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '318cea79-5b1b-41df-b862-3fb24bbb34aa', 'volume_name': 'volume-318cea79-5b1b-41df-b862-3fb24bbb34aa', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fceb4a2-0e1d-4058-bb6b-6340c9401bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fceb4a2-0e1d-4058-bb6b-6340c9401bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6235d72-7e43-4112-bb96-b057164accb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:09 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Volume 318cea79-5b1b-41df-b862-3fb24bbb34aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-318cea79-5b1b-41df-b862-3fb24bbb34aa', 'volume_size': 1} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1158469829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=318cea79-5b1b-41df-b862-3fb24bbb34aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8a8eb49c1b4829ae457fc94e4a2579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:09Z,use_quota=True,user_id='1d4001dc5c6a4c49afc6ca5d970aae8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Creating volume 318cea79-5b1b-41df-b862-3fb24bbb34aa {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:33:09 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:09 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa 1073741824 Nov 03 08:33:09 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-4471b2f6-c3f0-484b-9290-770e886de27c tempest-ProjectReaderTests-1754000686 None] Created reservations ['fc6c8e2f-f46c-421d-b741-f1509ba7a302', '9a6e8b79-1f7c-4863-860e-751e21becb6e', 'a34e5038-4ce5-4085-8ca7-29080bddcaf5', '51fb1911-e957-4b6e-bf2e-ac9cc0b82fbe'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4471b2f6-c3f0-484b-9290-770e886de27c tempest-ProjectReaderTests-1754000686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4471b2f6-c3f0-484b-9290-770e886de27c tempest-ProjectReaderTests-1754000686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4471b2f6-c3f0-484b-9290-770e886de27c tempest-ProjectReaderTests-1754000686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-4471b2f6-c3f0-484b-9290-770e886de27c tempest-ProjectReaderTests-1754000686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-4471b2f6-c3f0-484b-9290-770e886de27c tempest-ProjectReaderTests-1754000686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4471b2f6-c3f0-484b-9290-770e886de27c tempest-ProjectReaderTests-1754000686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:09 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:33:09 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:09 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-4471b2f6-c3f0-484b-9290-770e886de27c tempest-ProjectReaderTests-1754000686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.289s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-4471b2f6-c3f0-484b-9290-770e886de27c tempest-ProjectReaderTests-1754000686 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:33:09 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa 1073741824" returned: 0 in 0.514s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:09 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-4471b2f6-c3f0-484b-9290-770e886de27c tempest-ProjectReaderTests-1754000686 None] Deleted volume successfully. Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-4471b2f6-c3f0-484b-9290-770e886de27c tempest-ProjectReaderTests-1754000686 None] Lock "cinder-5e9ec2aa-1f4d-44b8-9536-9635700eba28-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:09 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa Nov 03 08:33:09 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:09 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa" returned: 0 in 0.258s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6235d72-7e43-4112-bb96-b057164accb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-318cea79-5b1b-41df-b862-3fb24bbb34aa', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c3ec67-08bd-49f9-a081-5ef69ee2e41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:09 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Volume volume-318cea79-5b1b-41df-b862-3fb24bbb34aa (318cea79-5b1b-41df-b862-3fb24bbb34aa): created successfully Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c3ec67-08bd-49f9-a081-5ef69ee2e41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Flow 'volume_create_manager' (185963b7-1814-41c4-855e-28903fa18b8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:09 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-8fd3410f-4350-4359-8ad3-36941aaca23c tempest-ProjectReaderTests-1056302893 None] Created volume successfully. Nov 03 08:33:10 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:33:10 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Flow 'volume_create_manager' (975d7b7b-7577-4418-976d-b75d8b785168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:10 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef2d223-fba4-4bb2-904a-bcb93540a5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:10 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef2d223-fba4-4bb2-904a-bcb93540a5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1713699237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aac1f4cd-d56e-470c-bbb3-16fb4147edd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682c6c6386be454884735db38fc738c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:11Z,use_quota=True,user_id='de4b4cdf24174c26987ef244c8794272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:10 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39563ad0-e5d0-4800-b950-85408cc8cda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:10 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39563ad0-e5d0-4800-b950-85408cc8cda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:10 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54b77999-9dec-40c9-9b52-affbdc9329f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:10 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54b77999-9dec-40c9-9b52-affbdc9329f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aac1f4cd-d56e-470c-bbb3-16fb4147edd5', 'volume_name': 'volume-aac1f4cd-d56e-470c-bbb3-16fb4147edd5', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:10 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d686653-c958-49d6-841d-2fbdd113021f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:10 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d686653-c958-49d6-841d-2fbdd113021f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:10 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2edc15ea-57e8-4ce5-968f-52022fa3705a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:10 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Volume aac1f4cd-d56e-470c-bbb3-16fb4147edd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aac1f4cd-d56e-470c-bbb3-16fb4147edd5', 'volume_size': 1} Nov 03 08:33:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:10 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1713699237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aac1f4cd-d56e-470c-bbb3-16fb4147edd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682c6c6386be454884735db38fc738c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:11Z,use_quota=True,user_id='de4b4cdf24174c26987ef244c8794272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:33:10 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Creating volume aac1f4cd-d56e-470c-bbb3-16fb4147edd5 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:33:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:10 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:10 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:10 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:33:10 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:33:10 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aac1f4cd-d56e-470c-bbb3-16fb4147edd5 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:10 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aac1f4cd-d56e-470c-bbb3-16fb4147edd5 1073741824 Nov 03 08:33:10 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b7ec9c99-7e22-481c-a02a-1e57717e0110 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:11 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aac1f4cd-d56e-470c-bbb3-16fb4147edd5 1073741824" returned: 0 in 0.629s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aac1f4cd-d56e-470c-bbb3-16fb4147edd5 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:11 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aac1f4cd-d56e-470c-bbb3-16fb4147edd5 Nov 03 08:33:11 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:11 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aac1f4cd-d56e-470c-bbb3-16fb4147edd5" returned: 0 in 0.390s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:11 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:33:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b7ec9c99-7e22-481c-a02a-1e57717e0110 tempest-ProjectReaderTests-1056302893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.456s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2edc15ea-57e8-4ce5-968f-52022fa3705a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aac1f4cd-d56e-470c-bbb3-16fb4147edd5', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27222ed1-98a3-4aa6-b876-5dda45b0c17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:11 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-b7ec9c99-7e22-481c-a02a-1e57717e0110 tempest-ProjectReaderTests-1056302893 None] Creating offline snapshot 603ae673-d170-4da7-81ce-4ef6e6958caa of volume 318cea79-5b1b-41df-b862-3fb24bbb34aa {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:33:11 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Volume volume-aac1f4cd-d56e-470c-bbb3-16fb4147edd5 (aac1f4cd-d56e-470c-bbb3-16fb4147edd5): created successfully Nov 03 08:33:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27222ed1-98a3-4aa6-b876-5dda45b0c17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:11 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Flow 'volume_create_manager' (975d7b7b-7577-4418-976d-b75d8b785168) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:11 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ef4b20-9880-4bc3-9545-6dc96b541e6b]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b7ec9c99-7e22-481c-a02a-1e57717e0110 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:11 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-dd7978c6-6b59-48d6-bacb-c1ea49b99657 tempest-ProjectReaderTests-1754000686 None] Created volume successfully. Nov 03 08:33:11 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa Nov 03 08:33:11 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:12 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b7ec9c99-7e22-481c-a02a-1e57717e0110 tempest-ProjectReaderTests-1056302893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa" returned: 0 in 0.388s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b7ec9c99-7e22-481c-a02a-1e57717e0110 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa.603ae673-d170-4da7-81ce-4ef6e6958caa 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:12 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa.603ae673-d170-4da7-81ce-4ef6e6958caa 1G Nov 03 08:33:12 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:12 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b7ec9c99-7e22-481c-a02a-1e57717e0110 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa.603ae673-d170-4da7-81ce-4ef6e6958caa 1G" returned: 0 in 0.506s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b7ec9c99-7e22-481c-a02a-1e57717e0110 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-318cea79-5b1b-41df-b862-3fb24bbb34aa -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa.603ae673-d170-4da7-81ce-4ef6e6958caa {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:12 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-318cea79-5b1b-41df-b862-3fb24bbb34aa -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa.603ae673-d170-4da7-81ce-4ef6e6958caa Nov 03 08:33:12 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:12 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1f3efc78-c52c-4b68-981c-2747e149c778 tempest-ProjectReaderTests-1754000686 None] Acquiring lock "cinder-aac1f4cd-d56e-470c-bbb3-16fb4147edd5-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:12 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1f3efc78-c52c-4b68-981c-2747e149c778 tempest-ProjectReaderTests-1754000686 None] Lock "cinder-aac1f4cd-d56e-470c-bbb3-16fb4147edd5-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:12 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:33:12 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Flow 'volume_create_manager' (ef3394f9-836e-4a9e-8968-92c06ea3ed02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:12 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1789edbe-a9ae-4142-99d4-14515c551cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:12 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1789edbe-a9ae-4142-99d4-14515c551cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3972d319-5495-486a-b757-6e407a8b6596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3397d87c4192411c937c925845c66fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:13Z,use_quota=True,user_id='198b751ac8554f7c84853c320ffe5791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:12 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75516a8f-bb82-4beb-b71d-a02c42868b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:12 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75516a8f-bb82-4beb-b71d-a02c42868b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b9e5fb-351a-4b81-8895-5bef5a488d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:13 devstack cinder-volume[86801]: DEBUG cinder.image.glance [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Creating Keystone auth plugin from conf {{(pid=86801) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 08:33:13 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1f3efc78-c52c-4b68-981c-2747e149c778 tempest-ProjectReaderTests-1754000686 None] Acquiring lock "cinder-quobyte-aac1f4cd-d56e-470c-bbb3-16fb4147edd5" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:13 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1f3efc78-c52c-4b68-981c-2747e149c778 tempest-ProjectReaderTests-1754000686 None] Lock "cinder-quobyte-aac1f4cd-d56e-470c-bbb3-16fb4147edd5" acquired by "delete_volume" :: waited 0.020s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:13 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[807ba109-a056-448b-96dd-18a35c2a88cd]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1f3efc78-c52c-4b68-981c-2747e149c778 tempest-ProjectReaderTests-1754000686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aac1f4cd-d56e-470c-bbb3-16fb4147edd5 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:13 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b7ec9c99-7e22-481c-a02a-1e57717e0110 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-318cea79-5b1b-41df-b862-3fb24bbb34aa -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa.603ae673-d170-4da7-81ce-4ef6e6958caa" returned: 0 in 0.426s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:13 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-b7ec9c99-7e22-481c-a02a-1e57717e0110 tempest-ProjectReaderTests-1056302893 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa.603ae673-d170-4da7-81ce-4ef6e6958caa is being set with open permissions: ugo+rw Nov 03 08:33:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b7ec9c99-7e22-481c-a02a-1e57717e0110 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa.603ae673-d170-4da7-81ce-4ef6e6958caa {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:13 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa.603ae673-d170-4da7-81ce-4ef6e6958caa Nov 03 08:33:13 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:13 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aac1f4cd-d56e-470c-bbb3-16fb4147edd5 Nov 03 08:33:13 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b9e5fb-351a-4b81-8895-5bef5a488d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3972d319-5495-486a-b757-6e407a8b6596', 'volume_name': 'volume-3972d319-5495-486a-b757-6e407a8b6596', 'volume_size': 1, 'image_id': '6e6b883b-e35b-4588-b573-4e5f8ad59829', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e6b883b-e35b-4588-b573-4e5f8ad59829', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '778e64b54ab0b2fe0b108cc1250afd1f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3397d87c4192411c937c925845c66fb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2cd63fb0b214d7a3dd74986ff6c74450cd33ae180c39fd7186c8171aaf7e5db878384a7167feaf933f963a9490130eb8ece37383aa46f56acf78e17d67cbfc70', 'id': '6e6b883b-e35b-4588-b573-4e5f8ad59829', 'created_at': datetime.datetime(2026, 11, 3, 7, 33, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 33, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e6b883b-e35b-4588-b573-4e5f8ad59829/file', 'properties': {}}, 'image_service': }' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fba7318-50cf-45e5-a374-2db4dd458601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fba7318-50cf-45e5-a374-2db4dd458601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:13 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89e86b05-cc98-4757-9640-7d98d402751e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:13 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Volume 3972d319-5495-486a-b757-6e407a8b6596: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3972d319-5495-486a-b757-6e407a8b6596', 'volume_size': 1, 'image_id': '6e6b883b-e35b-4588-b573-4e5f8ad59829', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e6b883b-e35b-4588-b573-4e5f8ad59829', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '778e64b54ab0b2fe0b108cc1250afd1f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3397d87c4192411c937c925845c66fb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2cd63fb0b214d7a3dd74986ff6c74450cd33ae180c39fd7186c8171aaf7e5db878384a7167feaf933f963a9490130eb8ece37383aa46f56acf78e17d67cbfc70', 'id': '6e6b883b-e35b-4588-b573-4e5f8ad59829', 'created_at': datetime.datetime(2026, 11, 3, 7, 33, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 33, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e6b883b-e35b-4588-b573-4e5f8ad59829/file', 'properties': {}}, 'image_service': } Nov 03 08:33:13 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Trying to clone 3972d319-5495-486a-b757-6e407a8b6596 from image 6e6b883b-e35b-4588-b573-4e5f8ad59829 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6e6b883b-e35b-4588-b573-4e5f8ad59829', 'metadata': {}}]). {{(pid=86801) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 08:33:13 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b7ec9c99-7e22-481c-a02a-1e57717e0110 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa.603ae673-d170-4da7-81ce-4ef6e6958caa" returned: 0 in 0.344s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:13 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6e6b883b-e35b-4588-b573-4e5f8ad59829_cm4sn4ozdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 08:33:13 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Image download 0.00 MB at 0.00 MB/s Nov 03 08:33:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b7ec9c99-7e22-481c-a02a-1e57717e0110 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:13 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1f3efc78-c52c-4b68-981c-2747e149c778 tempest-ProjectReaderTests-1754000686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aac1f4cd-d56e-470c-bbb3-16fb4147edd5" returned: 0 in 0.477s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1f3efc78-c52c-4b68-981c-2747e149c778 tempest-ProjectReaderTests-1754000686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aac1f4cd-d56e-470c-bbb3-16fb4147edd5 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:13 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa.info Nov 03 08:33:13 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:13 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aac1f4cd-d56e-470c-bbb3-16fb4147edd5 Nov 03 08:33:13 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:13 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[7726d2be-1cdd-4520-8cd4-b21a76401a78]: (4, 'raw') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6b883b-e35b-4588-b573-4e5f8ad59829_cm4sn4ozdevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:13 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6b883b-e35b-4588-b573-4e5f8ad59829_cm4sn4ozdevstack@QuobyteHD Nov 03 08:33:13 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:13 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b7ec9c99-7e22-481c-a02a-1e57717e0110 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa.info" returned: 0 in 0.327s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:13 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-b7ec9c99-7e22-481c-a02a-1e57717e0110 tempest-ProjectReaderTests-1056302893 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa.info is being set with open permissions: ugo+rw Nov 03 08:33:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b7ec9c99-7e22-481c-a02a-1e57717e0110 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:13 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1f3efc78-c52c-4b68-981c-2747e149c778 tempest-ProjectReaderTests-1754000686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-aac1f4cd-d56e-470c-bbb3-16fb4147edd5" returned: 0 in 0.317s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:13 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa.info Nov 03 08:33:13 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:13 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1f3efc78-c52c-4b68-981c-2747e149c778 tempest-ProjectReaderTests-1754000686 None] Lock "cinder-quobyte-aac1f4cd-d56e-470c-bbb3-16fb4147edd5" released by "delete_volume" :: held 0.859s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:13 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-1f3efc78-c52c-4b68-981c-2747e149c778 tempest-ProjectReaderTests-1754000686 None] Created reservations ['ccf1378a-7ffb-406f-a119-2480a8a0d58e', 'a608d440-a1f5-48b9-92c8-d61b0fa71c5a', '30a30b31-8a1e-4be4-a139-bd900eb30d26', '24e0f7a2-e3cf-4c70-b624-b7c194253728'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1f3efc78-c52c-4b68-981c-2747e149c778 tempest-ProjectReaderTests-1754000686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1f3efc78-c52c-4b68-981c-2747e149c778 tempest-ProjectReaderTests-1754000686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1f3efc78-c52c-4b68-981c-2747e149c778 tempest-ProjectReaderTests-1754000686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1f3efc78-c52c-4b68-981c-2747e149c778 tempest-ProjectReaderTests-1754000686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1f3efc78-c52c-4b68-981c-2747e149c778 tempest-ProjectReaderTests-1754000686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1f3efc78-c52c-4b68-981c-2747e149c778 tempest-ProjectReaderTests-1754000686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:14 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6b883b-e35b-4588-b573-4e5f8ad59829_cm4sn4ozdevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6b883b-e35b-4588-b573-4e5f8ad59829_cm4sn4ozdevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:14 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:33:14 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:14 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b7ec9c99-7e22-481c-a02a-1e57717e0110 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa.info" returned: 0 in 0.315s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b7ec9c99-7e22-481c-a02a-1e57717e0110 tempest-ProjectReaderTests-1056302893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.447s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:14 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6b883b-e35b-4588-b573-4e5f8ad59829_cm4sn4ozdevstack@QuobyteHD Nov 03 08:33:14 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:14 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-b7ec9c99-7e22-481c-a02a-1e57717e0110 tempest-ProjectReaderTests-1056302893 None] Create snapshot completed successfully Nov 03 08:33:14 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1f3efc78-c52c-4b68-981c-2747e149c778 tempest-ProjectReaderTests-1754000686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.318s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-1f3efc78-c52c-4b68-981c-2747e149c778 tempest-ProjectReaderTests-1754000686 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:33:14 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-1f3efc78-c52c-4b68-981c-2747e149c778 tempest-ProjectReaderTests-1754000686 None] Deleted volume successfully. Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1f3efc78-c52c-4b68-981c-2747e149c778 tempest-ProjectReaderTests-1754000686 None] Lock "cinder-aac1f4cd-d56e-470c-bbb3-16fb4147edd5-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:14 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6b883b-e35b-4588-b573-4e5f8ad59829_cm4sn4ozdevstack@QuobyteHD" returned: 1 in 0.381s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6b883b-e35b-4588-b573-4e5f8ad59829_cm4sn4ozdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Temporary image 6e6b883b-e35b-4588-b573-4e5f8ad59829 is fetched for user 198b751ac8554f7c84853c320ffe5791. {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6a22bcea-3473-4017-8ea1-273cbdbbd042 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "cinder-603ae673-d170-4da7-81ce-4ef6e6958caa-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6a22bcea-3473-4017-8ea1-273cbdbbd042 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-603ae673-d170-4da7-81ce-4ef6e6958caa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6a22bcea-3473-4017-8ea1-273cbdbbd042 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "cinder-quobyte-318cea79-5b1b-41df-b862-3fb24bbb34aa" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7a20a5-f910-44d9-be7f-5dd052577f51]: (4, 'raw') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6b883b-e35b-4588-b573-4e5f8ad59829_cm4sn4ozdevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6a22bcea-3473-4017-8ea1-273cbdbbd042 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-318cea79-5b1b-41df-b862-3fb24bbb34aa" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6a22bcea-3473-4017-8ea1-273cbdbbd042 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "cinder-quobyte-603ae673-d170-4da7-81ce-4ef6e6958caa" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6a22bcea-3473-4017-8ea1-273cbdbbd042 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-603ae673-d170-4da7-81ce-4ef6e6958caa" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-6a22bcea-3473-4017-8ea1-273cbdbbd042 tempest-ProjectReaderTests-1056302893 None] Deleting offline snapshot 603ae673-d170-4da7-81ce-4ef6e6958caa of volume 318cea79-5b1b-41df-b862-3fb24bbb34aa {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-6a22bcea-3473-4017-8ea1-273cbdbbd042 tempest-ProjectReaderTests-1056302893 None] snapshot_file for this snap is: volume-318cea79-5b1b-41df-b862-3fb24bbb34aa.603ae673-d170-4da7-81ce-4ef6e6958caa {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3747d0e-ec1e-4019-a064-d5604773d299]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6a22bcea-3473-4017-8ea1-273cbdbbd042 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa.603ae673-d170-4da7-81ce-4ef6e6958caa {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:14 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6b883b-e35b-4588-b573-4e5f8ad59829_cm4sn4ozdevstack@QuobyteHD Nov 03 08:33:14 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:14 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa.603ae673-d170-4da7-81ce-4ef6e6958caa Nov 03 08:33:14 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:14 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6b883b-e35b-4588-b573-4e5f8ad59829_cm4sn4ozdevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6b883b-e35b-4588-b573-4e5f8ad59829_cm4sn4ozdevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:15 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6b883b-e35b-4588-b573-4e5f8ad59829_cm4sn4ozdevstack@QuobyteHD Nov 03 08:33:15 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:15 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6a22bcea-3473-4017-8ea1-273cbdbbd042 tempest-ProjectReaderTests-1056302893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa.603ae673-d170-4da7-81ce-4ef6e6958caa" returned: 0 in 0.477s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-6a22bcea-3473-4017-8ea1-273cbdbbd042 tempest-ProjectReaderTests-1056302893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-318cea79-5b1b-41df-b862-3fb24bbb34aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc3d200-4adb-4b86-8283-0c90a1c2e835]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6a22bcea-3473-4017-8ea1-273cbdbbd042 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:15 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa Nov 03 08:33:15 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:15 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6b883b-e35b-4588-b573-4e5f8ad59829_cm4sn4ozdevstack@QuobyteHD" returned: 1 in 0.372s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6b883b-e35b-4588-b573-4e5f8ad59829_cm4sn4ozdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3972d319-5495-486a-b757-6e407a8b6596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3397d87c4192411c937c925845c66fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:13Z,use_quota=True,user_id='198b751ac8554f7c84853c320ffe5791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Creating volume 3972d319-5495-486a-b757-6e407a8b6596 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:33:15 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3972d319-5495-486a-b757-6e407a8b6596 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:15 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3972d319-5495-486a-b757-6e407a8b6596 1073741824 Nov 03 08:33:15 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:15 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6a22bcea-3473-4017-8ea1-273cbdbbd042 tempest-ProjectReaderTests-1056302893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa" returned: 0 in 0.510s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6a22bcea-3473-4017-8ea1-273cbdbbd042 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa.603ae673-d170-4da7-81ce-4ef6e6958caa {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:15 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa.603ae673-d170-4da7-81ce-4ef6e6958caa Nov 03 08:33:15 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Flow 'volume_create_manager' (a49f5c4a-7cfa-4a9d-b82f-650708aa9b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f70742-b0b0-446a-90b5-6b067f18d70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f70742-b0b0-446a-90b5-6b067f18d70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1904799857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bbe806a-a5d4-41fb-9c2b-7a8122f9b4a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682c6c6386be454884735db38fc738c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:16Z,use_quota=True,user_id='de4b4cdf24174c26987ef244c8794272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb8fcd8-e485-4abe-a19e-2ed32e8e18c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb8fcd8-e485-4abe-a19e-2ed32e8e18c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ebe6eb5-b877-4203-bc5c-0911eaf0a39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ebe6eb5-b877-4203-bc5c-0911eaf0a39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bbe806a-a5d4-41fb-9c2b-7a8122f9b4a8', 'volume_name': 'volume-2bbe806a-a5d4-41fb-9c2b-7a8122f9b4a8', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a797d33-818e-4fb5-9a7f-7b1180f1e1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a797d33-818e-4fb5-9a7f-7b1180f1e1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5f264c-5c00-4494-8471-241a84abc5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:15 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Volume 2bbe806a-a5d4-41fb-9c2b-7a8122f9b4a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bbe806a-a5d4-41fb-9c2b-7a8122f9b4a8', 'volume_size': 1} Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:15 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3972d319-5495-486a-b757-6e407a8b6596 1073741824" returned: 0 in 0.587s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3972d319-5495-486a-b757-6e407a8b6596 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:16 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3972d319-5495-486a-b757-6e407a8b6596 Nov 03 08:33:16 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:16 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6a22bcea-3473-4017-8ea1-273cbdbbd042 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa.603ae673-d170-4da7-81ce-4ef6e6958caa" returned: 0 in 0.421s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6a22bcea-3473-4017-8ea1-273cbdbbd042 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa.603ae673-d170-4da7-81ce-4ef6e6958caa {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:16 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa.603ae673-d170-4da7-81ce-4ef6e6958caa Nov 03 08:33:16 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:16 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3972d319-5495-486a-b757-6e407a8b6596" returned: 0 in 0.268s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.404s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1904799857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bbe806a-a5d4-41fb-9c2b-7a8122f9b4a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682c6c6386be454884735db38fc738c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:16Z,use_quota=True,user_id='de4b4cdf24174c26987ef244c8794272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Creating volume 2bbe806a-a5d4-41fb-9c2b-7a8122f9b4a8 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:33:16 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2bbe806a-a5d4-41fb-9c2b-7a8122f9b4a8 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:16 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2bbe806a-a5d4-41fb-9c2b-7a8122f9b4a8 1073741824 Nov 03 08:33:16 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Attempting download of 6e6b883b-e35b-4588-b573-4e5f8ad59829 ((None, [{'url': 'file:///opt/stack/data/glance/images/6e6b883b-e35b-4588-b573-4e5f8ad59829', 'metadata': {}}])) to volume 3972d319-5495-486a-b757-6e407a8b6596. {{(pid=86801) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e1e420-bfc6-4210-ad0a-3cab98ada586]: (4, 'raw') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e6b883b-e35b-4588-b573-4e5f8ad59829_z1_x5et2 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:16 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6a22bcea-3473-4017-8ea1-273cbdbbd042 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa.603ae673-d170-4da7-81ce-4ef6e6958caa" returned: 0 in 0.293s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6a22bcea-3473-4017-8ea1-273cbdbbd042 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-603ae673-d170-4da7-81ce-4ef6e6958caa" released by "_delete_snapshot" :: held 1.834s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6a22bcea-3473-4017-8ea1-273cbdbbd042 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-318cea79-5b1b-41df-b862-3fb24bbb34aa" released by "delete_snapshot" :: held 1.861s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:16 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e6b883b-e35b-4588-b573-4e5f8ad59829_z1_x5et2 Nov 03 08:33:16 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-6a22bcea-3473-4017-8ea1-273cbdbbd042 tempest-ProjectReaderTests-1056302893 None] Created reservations ['a5db948e-01a7-4fe0-9894-dce02535a98c', '6f8551d0-9054-4c86-92bf-2db9b766564b', '4d693bbb-f1ed-4bdc-a3dd-155cba84ab71', 'fde510a3-8341-4157-8d2e-f19b953c0902'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:33:16 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-6a22bcea-3473-4017-8ea1-273cbdbbd042 tempest-ProjectReaderTests-1056302893 None] Delete snapshot completed successfully. Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-6a22bcea-3473-4017-8ea1-273cbdbbd042 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-603ae673-d170-4da7-81ce-4ef6e6958caa-delete_snapshot" released by "delete_snapshot" :: held 2.065s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:16 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6e6b883b-e35b-4588-b573-4e5f8ad59829_z1_x5et2" returned: 0 in 0.387s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e6b883b-e35b-4588-b573-4e5f8ad59829_z1_x5et2 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b16f6eec-b602-40b1-a6fd-38530a4165a3 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "cinder-318cea79-5b1b-41df-b862-3fb24bbb34aa-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b16f6eec-b602-40b1-a6fd-38530a4165a3 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-318cea79-5b1b-41df-b862-3fb24bbb34aa-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b16f6eec-b602-40b1-a6fd-38530a4165a3 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "cinder-quobyte-318cea79-5b1b-41df-b862-3fb24bbb34aa" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b16f6eec-b602-40b1-a6fd-38530a4165a3 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-318cea79-5b1b-41df-b862-3fb24bbb34aa" acquired by "delete_volume" :: waited 0.018s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:16 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:16 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e6b883b-e35b-4588-b573-4e5f8ad59829_z1_x5et2 Nov 03 08:33:16 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2bbe806a-a5d4-41fb-9c2b-7a8122f9b4a8 1073741824" returned: 0 in 0.645s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b49b06-fed6-4907-b2ad-8964a725189e]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b16f6eec-b602-40b1-a6fd-38530a4165a3 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2bbe806a-a5d4-41fb-9c2b-7a8122f9b4a8 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:17 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2bbe806a-a5d4-41fb-9c2b-7a8122f9b4a8 Nov 03 08:33:17 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:17 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa Nov 03 08:33:17 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:17 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e6b883b-e35b-4588-b573-4e5f8ad59829_z1_x5et2" returned: 1 in 0.434s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6e6b883b-e35b-4588-b573-4e5f8ad59829_z1_x5et2' failed. Not Retrying. {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 08:33:17 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ce5459-782a-4a46-928a-56289c4b0497]: (4, 'raw') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6b883b-e35b-4588-b573-4e5f8ad59829_cm4sn4ozdevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:17 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6b883b-e35b-4588-b573-4e5f8ad59829_cm4sn4ozdevstack@QuobyteHD Nov 03 08:33:17 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:17 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2bbe806a-a5d4-41fb-9c2b-7a8122f9b4a8" returned: 0 in 0.387s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:17 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:33:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5f264c-5c00-4494-8471-241a84abc5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bbe806a-a5d4-41fb-9c2b-7a8122f9b4a8', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (556c8412-1ccb-4281-92e1-4cefb6509119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:17 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Volume volume-2bbe806a-a5d4-41fb-9c2b-7a8122f9b4a8 (2bbe806a-a5d4-41fb-9c2b-7a8122f9b4a8): created successfully Nov 03 08:33:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (556c8412-1ccb-4281-92e1-4cefb6509119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:17 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Flow 'volume_create_manager' (a49f5c4a-7cfa-4a9d-b82f-650708aa9b43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b16f6eec-b602-40b1-a6fd-38530a4165a3 tempest-ProjectReaderTests-1056302893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa" returned: 0 in 0.483s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b16f6eec-b602-40b1-a6fd-38530a4165a3 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:17 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-7a6cc905-6070-44ee-b756-6a0e35362cd4 tempest-ProjectReaderTests-1754000686 None] Created volume successfully. Nov 03 08:33:17 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa Nov 03 08:33:17 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:17 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6b883b-e35b-4588-b573-4e5f8ad59829_cm4sn4ozdevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6b883b-e35b-4588-b573-4e5f8ad59829_cm4sn4ozdevstack@QuobyteHD {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:17 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6b883b-e35b-4588-b573-4e5f8ad59829_cm4sn4ozdevstack@QuobyteHD Nov 03 08:33:17 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:17 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b16f6eec-b602-40b1-a6fd-38530a4165a3 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-318cea79-5b1b-41df-b862-3fb24bbb34aa" returned: 0 in 0.300s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:17 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b16f6eec-b602-40b1-a6fd-38530a4165a3 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-318cea79-5b1b-41df-b862-3fb24bbb34aa" released by "delete_volume" :: held 0.870s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:17 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-b16f6eec-b602-40b1-a6fd-38530a4165a3 tempest-ProjectReaderTests-1056302893 None] Created reservations ['5e333ba0-2879-44a2-8218-a74a068e54de', '483bb7a0-92a5-4b25-ad7d-b73f3a9ff9de', 'ad395e08-5764-41e4-9ac9-6a635590ffcf', '7c5f8bcc-577e-4d5e-9acb-51bc1c5e1c02'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:33:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b16f6eec-b602-40b1-a6fd-38530a4165a3 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b16f6eec-b602-40b1-a6fd-38530a4165a3 tempest-ProjectReaderTests-1056302893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:17 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b16f6eec-b602-40b1-a6fd-38530a4165a3 tempest-ProjectReaderTests-1056302893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:17 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b16f6eec-b602-40b1-a6fd-38530a4165a3 tempest-ProjectReaderTests-1056302893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b16f6eec-b602-40b1-a6fd-38530a4165a3 tempest-ProjectReaderTests-1056302893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b16f6eec-b602-40b1-a6fd-38530a4165a3 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:17 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1027b445-458e-434d-93cb-fd5e477b6f95 tempest-ProjectReaderTests-1754000686 None] Acquiring lock "cinder-2bbe806a-a5d4-41fb-9c2b-7a8122f9b4a8-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:17 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:17 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:33:17 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6b883b-e35b-4588-b573-4e5f8ad59829_cm4sn4ozdevstack@QuobyteHD" returned: 1 in 0.417s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6e6b883b-e35b-4588-b573-4e5f8ad59829_cm4sn4ozdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] 6e6b883b-e35b-4588-b573-4e5f8ad59829 was raw, converting to qcow2 {{(pid=86801) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6e6b883b-e35b-4588-b573-4e5f8ad59829_cm4sn4ozdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3972d319-5495-486a-b757-6e407a8b6596 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1027b445-458e-434d-93cb-fd5e477b6f95 tempest-ProjectReaderTests-1754000686 None] Lock "cinder-2bbe806a-a5d4-41fb-9c2b-7a8122f9b4a8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:18 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6e6b883b-e35b-4588-b573-4e5f8ad59829_cm4sn4ozdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3972d319-5495-486a-b757-6e407a8b6596 Nov 03 08:33:18 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1027b445-458e-434d-93cb-fd5e477b6f95 tempest-ProjectReaderTests-1754000686 None] Acquiring lock "cinder-quobyte-2bbe806a-a5d4-41fb-9c2b-7a8122f9b4a8" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1027b445-458e-434d-93cb-fd5e477b6f95 tempest-ProjectReaderTests-1754000686 None] Lock "cinder-quobyte-2bbe806a-a5d4-41fb-9c2b-7a8122f9b4a8" acquired by "delete_volume" :: waited 0.023s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53be27b-ddac-4d7e-b718-f44d18a6a2f7]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1027b445-458e-434d-93cb-fd5e477b6f95 tempest-ProjectReaderTests-1754000686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2bbe806a-a5d4-41fb-9c2b-7a8122f9b4a8 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:18 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2bbe806a-a5d4-41fb-9c2b-7a8122f9b4a8 Nov 03 08:33:18 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:18 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b16f6eec-b602-40b1-a6fd-38530a4165a3 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.517s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-b16f6eec-b602-40b1-a6fd-38530a4165a3 tempest-ProjectReaderTests-1056302893 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:33:18 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-b16f6eec-b602-40b1-a6fd-38530a4165a3 tempest-ProjectReaderTests-1056302893 None] Deleted volume successfully. Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b16f6eec-b602-40b1-a6fd-38530a4165a3 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-318cea79-5b1b-41df-b862-3fb24bbb34aa-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:18 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:18 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6e6b883b-e35b-4588-b573-4e5f8ad59829_cm4sn4ozdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3972d319-5495-486a-b757-6e407a8b6596" returned: 0 in 0.672s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6e6b883b-e35b-4588-b573-4e5f8ad59829_cm4sn4ozdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3972d319-5495-486a-b757-6e407a8b6596 {{(pid=86801) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 08:33:18 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3972d319-5495-486a-b757-6e407a8b6596 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1027b445-458e-434d-93cb-fd5e477b6f95 tempest-ProjectReaderTests-1754000686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2bbe806a-a5d4-41fb-9c2b-7a8122f9b4a8" returned: 0 in 0.556s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1027b445-458e-434d-93cb-fd5e477b6f95 tempest-ProjectReaderTests-1754000686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2bbe806a-a5d4-41fb-9c2b-7a8122f9b4a8 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:18 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3972d319-5495-486a-b757-6e407a8b6596 1G Nov 03 08:33:18 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:33:18 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2bbe806a-a5d4-41fb-9c2b-7a8122f9b4a8 Nov 03 08:33:18 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Flow 'volume_create_manager' (7832590e-bdd6-4322-839c-1499eeb30b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf73f5c5-57e5-4bbd-af36-0f2bd3d283bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf73f5c5-57e5-4bbd-af36-0f2bd3d283bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-331056316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac34038-166b-464d-b090-7b648f6b043a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8a8eb49c1b4829ae457fc94e4a2579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:19Z,use_quota=True,user_id='1d4001dc5c6a4c49afc6ca5d970aae8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (880b0e2e-cd60-4f79-ac98-a58dcc7eab9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (880b0e2e-cd60-4f79-ac98-a58dcc7eab9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a2cc3f4-48d4-4611-b57d-0f356b5a8b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a2cc3f4-48d4-4611-b57d-0f356b5a8b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ac34038-166b-464d-b090-7b648f6b043a', 'volume_name': 'volume-3ac34038-166b-464d-b090-7b648f6b043a', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b70a9360-4c46-49c0-9a67-13b315dcf5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b70a9360-4c46-49c0-9a67-13b315dcf5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2575aa26-f4f4-4e84-8daa-cc5840713107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:18 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Volume 3ac34038-166b-464d-b090-7b648f6b043a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ac34038-166b-464d-b090-7b648f6b043a', 'volume_size': 1} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-331056316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac34038-166b-464d-b090-7b648f6b043a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8a8eb49c1b4829ae457fc94e4a2579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:19Z,use_quota=True,user_id='1d4001dc5c6a4c49afc6ca5d970aae8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Creating volume 3ac34038-166b-464d-b090-7b648f6b043a {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:33:18 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:18 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a 1073741824 Nov 03 08:33:18 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:18 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1027b445-458e-434d-93cb-fd5e477b6f95 tempest-ProjectReaderTests-1754000686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2bbe806a-a5d4-41fb-9c2b-7a8122f9b4a8" returned: 0 in 0.290s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1027b445-458e-434d-93cb-fd5e477b6f95 tempest-ProjectReaderTests-1754000686 None] Lock "cinder-quobyte-2bbe806a-a5d4-41fb-9c2b-7a8122f9b4a8" released by "delete_volume" :: held 0.925s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:19 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3972d319-5495-486a-b757-6e407a8b6596 1G" returned: 0 in 0.381s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Downloaded image 6e6b883b-e35b-4588-b573-4e5f8ad59829 ((None, [{'url': 'file:///opt/stack/data/glance/images/6e6b883b-e35b-4588-b573-4e5f8ad59829', 'metadata': {}}])) to volume 3972d319-5495-486a-b757-6e407a8b6596 successfully. {{(pid=86801) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Temporary image 6e6b883b-e35b-4588-b573-4e5f8ad59829 for user 198b751ac8554f7c84853c320ffe5791 is deleted. {{(pid=86801) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG cinder.volume.volume_utils [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Marking volume 3972d319-5495-486a-b757-6e407a8b6596 as bootable. {{(pid=86801) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Copying metadata from image 6e6b883b-e35b-4588-b573-4e5f8ad59829 to 3972d319-5495-486a-b757-6e407a8b6596. {{(pid=86801) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Creating volume glance metadata for volume 3972d319-5495-486a-b757-6e407a8b6596 backed by image 6e6b883b-e35b-4588-b573-4e5f8ad59829 with: {'image_id': '6e6b883b-e35b-4588-b573-4e5f8ad59829', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '778e64b54ab0b2fe0b108cc1250afd1f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86801) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-1027b445-458e-434d-93cb-fd5e477b6f95 tempest-ProjectReaderTests-1754000686 None] Created reservations ['3d3b5f70-d92c-42ae-9bfc-cdf684addeba', '09d88966-1b0d-4b3d-8430-565bc1ca7cdb', '9b16dbcd-5aef-4476-b08f-21761e381186', '50eed2c4-571b-4ee3-bd9e-0b868f4878ea'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89e86b05-cc98-4757-9640-7d98d402751e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3972d319-5495-486a-b757-6e407a8b6596', 'volume_size': 1, 'image_id': '6e6b883b-e35b-4588-b573-4e5f8ad59829', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6e6b883b-e35b-4588-b573-4e5f8ad59829', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '778e64b54ab0b2fe0b108cc1250afd1f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3397d87c4192411c937c925845c66fb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2cd63fb0b214d7a3dd74986ff6c74450cd33ae180c39fd7186c8171aaf7e5db878384a7167feaf933f963a9490130eb8ece37383aa46f56acf78e17d67cbfc70', 'id': '6e6b883b-e35b-4588-b573-4e5f8ad59829', 'created_at': datetime.datetime(2026, 11, 3, 7, 33, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 7, 33, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6e6b883b-e35b-4588-b573-4e5f8ad59829/file', 'properties': {}}, 'image_service': }' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ac0260-38c5-4eca-ad7a-53d6531d2a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:19 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Volume volume-3972d319-5495-486a-b757-6e407a8b6596 (3972d319-5495-486a-b757-6e407a8b6596): created successfully Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ac0260-38c5-4eca-ad7a-53d6531d2a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Flow 'volume_create_manager' (ef3394f9-836e-4a9e-8968-92c06ea3ed02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1027b445-458e-434d-93cb-fd5e477b6f95 tempest-ProjectReaderTests-1754000686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1027b445-458e-434d-93cb-fd5e477b6f95 tempest-ProjectReaderTests-1754000686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1027b445-458e-434d-93cb-fd5e477b6f95 tempest-ProjectReaderTests-1754000686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1027b445-458e-434d-93cb-fd5e477b6f95 tempest-ProjectReaderTests-1754000686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1027b445-458e-434d-93cb-fd5e477b6f95 tempest-ProjectReaderTests-1754000686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1027b445-458e-434d-93cb-fd5e477b6f95 tempest-ProjectReaderTests-1754000686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:19 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-25c1412f-4a84-4a80-be6a-5994adbd1fa4 tempest-VolumeImageDependencyTests-343177367 None] Created volume successfully. Nov 03 08:33:19 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:33:19 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:19 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a 1073741824" returned: 0 in 0.606s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f526b11d-9743-425c-904a-726e1a52f4da tempest-VolumeImageDependencyTests-343177367 None] Acquiring lock "cinder-3972d319-5495-486a-b757-6e407a8b6596-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:19 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a Nov 03 08:33:19 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f526b11d-9743-425c-904a-726e1a52f4da tempest-VolumeImageDependencyTests-343177367 None] Lock "cinder-3972d319-5495-486a-b757-6e407a8b6596-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:19 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1027b445-458e-434d-93cb-fd5e477b6f95 tempest-ProjectReaderTests-1754000686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.300s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-1027b445-458e-434d-93cb-fd5e477b6f95 tempest-ProjectReaderTests-1754000686 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:33:19 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-1027b445-458e-434d-93cb-fd5e477b6f95 tempest-ProjectReaderTests-1754000686 None] Deleted volume successfully. Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1027b445-458e-434d-93cb-fd5e477b6f95 tempest-ProjectReaderTests-1754000686 None] Lock "cinder-2bbe806a-a5d4-41fb-9c2b-7a8122f9b4a8-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f526b11d-9743-425c-904a-726e1a52f4da tempest-VolumeImageDependencyTests-343177367 None] Acquiring lock "cinder-quobyte-3972d319-5495-486a-b757-6e407a8b6596" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f526b11d-9743-425c-904a-726e1a52f4da tempest-VolumeImageDependencyTests-343177367 None] Lock "cinder-quobyte-3972d319-5495-486a-b757-6e407a8b6596" acquired by "delete_volume" :: waited 0.015s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7229f37-7fc1-43c2-a32d-2102d8dc4edc]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f526b11d-9743-425c-904a-726e1a52f4da tempest-VolumeImageDependencyTests-343177367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3972d319-5495-486a-b757-6e407a8b6596 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:19 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3972d319-5495-486a-b757-6e407a8b6596 Nov 03 08:33:19 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:19 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a" returned: 0 in 0.347s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2575aa26-f4f4-4e84-8daa-cc5840713107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ac34038-166b-464d-b090-7b648f6b043a', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c9cd90-b840-40a1-abf4-11fc1e839e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:19 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Volume volume-3ac34038-166b-464d-b090-7b648f6b043a (3ac34038-166b-464d-b090-7b648f6b043a): created successfully Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c9cd90-b840-40a1-abf4-11fc1e839e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:19 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Flow 'volume_create_manager' (7832590e-bdd6-4322-839c-1499eeb30b8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:19 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-e7bc9727-e212-4d4b-8788-09c5812abd19 tempest-ProjectReaderTests-1056302893 None] Created volume successfully. Nov 03 08:33:20 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f526b11d-9743-425c-904a-726e1a52f4da tempest-VolumeImageDependencyTests-343177367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3972d319-5495-486a-b757-6e407a8b6596" returned: 0 in 0.392s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f526b11d-9743-425c-904a-726e1a52f4da tempest-VolumeImageDependencyTests-343177367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3972d319-5495-486a-b757-6e407a8b6596 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:20 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3972d319-5495-486a-b757-6e407a8b6596 Nov 03 08:33:20 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:20 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f526b11d-9743-425c-904a-726e1a52f4da tempest-VolumeImageDependencyTests-343177367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3972d319-5495-486a-b757-6e407a8b6596" returned: 0 in 0.291s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f526b11d-9743-425c-904a-726e1a52f4da tempest-VolumeImageDependencyTests-343177367 None] Lock "cinder-quobyte-3972d319-5495-486a-b757-6e407a8b6596" released by "delete_volume" :: held 0.731s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-f526b11d-9743-425c-904a-726e1a52f4da tempest-VolumeImageDependencyTests-343177367 None] Created reservations ['e65921d9-0c7b-42a1-8328-efcafb14831a', 'd14ac5f7-9264-4ca5-b64d-73e81f0a10cd', '404f4aea-9c53-4f84-b7ee-c35f53e3a386', 'c211c0bc-c310-4835-bef2-ed6efaceb319'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f526b11d-9743-425c-904a-726e1a52f4da tempest-VolumeImageDependencyTests-343177367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f526b11d-9743-425c-904a-726e1a52f4da tempest-VolumeImageDependencyTests-343177367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f526b11d-9743-425c-904a-726e1a52f4da tempest-VolumeImageDependencyTests-343177367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f526b11d-9743-425c-904a-726e1a52f4da tempest-VolumeImageDependencyTests-343177367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f526b11d-9743-425c-904a-726e1a52f4da tempest-VolumeImageDependencyTests-343177367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f526b11d-9743-425c-904a-726e1a52f4da tempest-VolumeImageDependencyTests-343177367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:20 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:33:20 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Flow 'volume_create_manager' (d6794d55-7601-464c-8bc4-42af4bced1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c523a5f-ecf1-42d6-987a-514d3a596bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c523a5f-ecf1-42d6-987a-514d3a596bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-866899208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=326faf36-6bb0-46a6-9f86-3d0093023948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682c6c6386be454884735db38fc738c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:21Z,use_quota=True,user_id='de4b4cdf24174c26987ef244c8794272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa206a02-7924-4c5f-90e0-5b36a0b1f123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa206a02-7924-4c5f-90e0-5b36a0b1f123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed70dff3-73d6-42b8-a610-a201bff22f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed70dff3-73d6-42b8-a610-a201bff22f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '326faf36-6bb0-46a6-9f86-3d0093023948', 'volume_name': 'volume-326faf36-6bb0-46a6-9f86-3d0093023948', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (612fc66a-560c-4da2-83dd-25fd8e8e27dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (612fc66a-560c-4da2-83dd-25fd8e8e27dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc9c7d7-6150-4e14-8ca5-ff25803f0ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:20 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Volume 326faf36-6bb0-46a6-9f86-3d0093023948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-326faf36-6bb0-46a6-9f86-3d0093023948', 'volume_size': 1} Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-866899208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=326faf36-6bb0-46a6-9f86-3d0093023948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682c6c6386be454884735db38fc738c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:21Z,use_quota=True,user_id='de4b4cdf24174c26987ef244c8794272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Creating volume 326faf36-6bb0-46a6-9f86-3d0093023948 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:20 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:33:20 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:33:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-326faf36-6bb0-46a6-9f86-3d0093023948 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f526b11d-9743-425c-904a-726e1a52f4da tempest-VolumeImageDependencyTests-343177367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.392s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:21 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-f526b11d-9743-425c-904a-726e1a52f4da tempest-VolumeImageDependencyTests-343177367 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:33:21 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-f526b11d-9743-425c-904a-726e1a52f4da tempest-VolumeImageDependencyTests-343177367 None] Deleted volume successfully. Nov 03 08:33:21 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-326faf36-6bb0-46a6-9f86-3d0093023948 1073741824 Nov 03 08:33:21 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-406181e5-fc76-4b88-a6fe-63266e669bf5 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:21 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f526b11d-9743-425c-904a-726e1a52f4da tempest-VolumeImageDependencyTests-343177367 None] Lock "cinder-3972d319-5495-486a-b757-6e407a8b6596-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:21 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-326faf36-6bb0-46a6-9f86-3d0093023948 1073741824" returned: 0 in 0.515s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-326faf36-6bb0-46a6-9f86-3d0093023948 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:21 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-326faf36-6bb0-46a6-9f86-3d0093023948 Nov 03 08:33:21 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:21 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-326faf36-6bb0-46a6-9f86-3d0093023948" returned: 0 in 0.269s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:21 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:33:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-406181e5-fc76-4b88-a6fe-63266e669bf5 tempest-ProjectReaderTests-1056302893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.738s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc9c7d7-6150-4e14-8ca5-ff25803f0ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-326faf36-6bb0-46a6-9f86-3d0093023948', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a217d622-b2e6-4bf2-b0cb-c1633a1bf20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:21 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-406181e5-fc76-4b88-a6fe-63266e669bf5 tempest-ProjectReaderTests-1056302893 None] Creating offline snapshot c8c81beb-37b6-428a-abd2-2ecc99ab4587 of volume 3ac34038-166b-464d-b090-7b648f6b043a {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:33:21 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Volume volume-326faf36-6bb0-46a6-9f86-3d0093023948 (326faf36-6bb0-46a6-9f86-3d0093023948): created successfully Nov 03 08:33:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a217d622-b2e6-4bf2-b0cb-c1633a1bf20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:21 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Flow 'volume_create_manager' (d6794d55-7601-464c-8bc4-42af4bced1a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:21 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[c165201e-0dfb-4923-b4c7-c8624e201496]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-406181e5-fc76-4b88-a6fe-63266e669bf5 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:21 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-91a8420b-4f96-401a-a3e0-ab9baa7f822e tempest-ProjectReaderTests-1754000686 None] Created volume successfully. Nov 03 08:33:22 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a Nov 03 08:33:22 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:22 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-406181e5-fc76-4b88-a6fe-63266e669bf5 tempest-ProjectReaderTests-1056302893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a" returned: 0 in 0.475s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-406181e5-fc76-4b88-a6fe-63266e669bf5 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a.c8c81beb-37b6-428a-abd2-2ecc99ab4587 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:22 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a.c8c81beb-37b6-428a-abd2-2ecc99ab4587 1G Nov 03 08:33:22 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f3127c58-1ef7-4ee3-ab15-d2337658f037 tempest-ProjectReaderTests-1754000686 None] Acquiring lock "cinder-326faf36-6bb0-46a6-9f86-3d0093023948-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:22 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-406181e5-fc76-4b88-a6fe-63266e669bf5 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a.c8c81beb-37b6-428a-abd2-2ecc99ab4587 1G" returned: 0 in 0.597s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-406181e5-fc76-4b88-a6fe-63266e669bf5 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ac34038-166b-464d-b090-7b648f6b043a -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a.c8c81beb-37b6-428a-abd2-2ecc99ab4587 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f3127c58-1ef7-4ee3-ab15-d2337658f037 tempest-ProjectReaderTests-1754000686 None] Lock "cinder-326faf36-6bb0-46a6-9f86-3d0093023948-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:22 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ac34038-166b-464d-b090-7b648f6b043a -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a.c8c81beb-37b6-428a-abd2-2ecc99ab4587 Nov 03 08:33:22 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:23 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f3127c58-1ef7-4ee3-ab15-d2337658f037 tempest-ProjectReaderTests-1754000686 None] Acquiring lock "cinder-quobyte-326faf36-6bb0-46a6-9f86-3d0093023948" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:23 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f3127c58-1ef7-4ee3-ab15-d2337658f037 tempest-ProjectReaderTests-1754000686 None] Lock "cinder-quobyte-326faf36-6bb0-46a6-9f86-3d0093023948" acquired by "delete_volume" :: waited 0.020s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:23 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[561eace1-336e-42b3-88e3-496b34ee40d7]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f3127c58-1ef7-4ee3-ab15-d2337658f037 tempest-ProjectReaderTests-1754000686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-326faf36-6bb0-46a6-9f86-3d0093023948 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:23 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-326faf36-6bb0-46a6-9f86-3d0093023948 Nov 03 08:33:23 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:23 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-406181e5-fc76-4b88-a6fe-63266e669bf5 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ac34038-166b-464d-b090-7b648f6b043a -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a.c8c81beb-37b6-428a-abd2-2ecc99ab4587" returned: 0 in 0.500s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:23 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-406181e5-fc76-4b88-a6fe-63266e669bf5 tempest-ProjectReaderTests-1056302893 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a.c8c81beb-37b6-428a-abd2-2ecc99ab4587 is being set with open permissions: ugo+rw Nov 03 08:33:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-406181e5-fc76-4b88-a6fe-63266e669bf5 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a.c8c81beb-37b6-428a-abd2-2ecc99ab4587 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:23 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a.c8c81beb-37b6-428a-abd2-2ecc99ab4587 Nov 03 08:33:23 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:23 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f3127c58-1ef7-4ee3-ab15-d2337658f037 tempest-ProjectReaderTests-1754000686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-326faf36-6bb0-46a6-9f86-3d0093023948" returned: 0 in 0.569s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f3127c58-1ef7-4ee3-ab15-d2337658f037 tempest-ProjectReaderTests-1754000686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-326faf36-6bb0-46a6-9f86-3d0093023948 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:23 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-326faf36-6bb0-46a6-9f86-3d0093023948 Nov 03 08:33:23 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:23 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-406181e5-fc76-4b88-a6fe-63266e669bf5 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a.c8c81beb-37b6-428a-abd2-2ecc99ab4587" returned: 0 in 0.386s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-406181e5-fc76-4b88-a6fe-63266e669bf5 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:23 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a.info Nov 03 08:33:23 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:24 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f3127c58-1ef7-4ee3-ab15-d2337658f037 tempest-ProjectReaderTests-1754000686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-326faf36-6bb0-46a6-9f86-3d0093023948" returned: 0 in 0.347s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:24 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f3127c58-1ef7-4ee3-ab15-d2337658f037 tempest-ProjectReaderTests-1754000686 None] Lock "cinder-quobyte-326faf36-6bb0-46a6-9f86-3d0093023948" released by "delete_volume" :: held 1.003s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:24 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-f3127c58-1ef7-4ee3-ab15-d2337658f037 tempest-ProjectReaderTests-1754000686 None] Created reservations ['ec36b5c3-5dfc-4847-a31b-9d803bc77b03', '1aa16271-60ea-46b2-8ff6-52a9b7e495c8', '9f82e08f-4e2a-4111-b61b-82ff13854a2b', '2f076399-852b-419b-a073-b5532d58b4ea'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:33:24 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-406181e5-fc76-4b88-a6fe-63266e669bf5 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a.info" returned: 0 in 0.342s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:24 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-406181e5-fc76-4b88-a6fe-63266e669bf5 tempest-ProjectReaderTests-1056302893 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a.info is being set with open permissions: ugo+rw Nov 03 08:33:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-406181e5-fc76-4b88-a6fe-63266e669bf5 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:24 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a.info Nov 03 08:33:24 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f3127c58-1ef7-4ee3-ab15-d2337658f037 tempest-ProjectReaderTests-1754000686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f3127c58-1ef7-4ee3-ab15-d2337658f037 tempest-ProjectReaderTests-1754000686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f3127c58-1ef7-4ee3-ab15-d2337658f037 tempest-ProjectReaderTests-1754000686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-f3127c58-1ef7-4ee3-ab15-d2337658f037 tempest-ProjectReaderTests-1754000686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f3127c58-1ef7-4ee3-ab15-d2337658f037 tempest-ProjectReaderTests-1754000686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f3127c58-1ef7-4ee3-ab15-d2337658f037 tempest-ProjectReaderTests-1754000686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:24 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:33:24 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:24 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-406181e5-fc76-4b88-a6fe-63266e669bf5 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a.info" returned: 0 in 0.312s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-406181e5-fc76-4b88-a6fe-63266e669bf5 tempest-ProjectReaderTests-1056302893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.747s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:24 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-406181e5-fc76-4b88-a6fe-63266e669bf5 tempest-ProjectReaderTests-1056302893 None] Create snapshot completed successfully Nov 03 08:33:24 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f3127c58-1ef7-4ee3-ab15-d2337658f037 tempest-ProjectReaderTests-1754000686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.297s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:24 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-f3127c58-1ef7-4ee3-ab15-d2337658f037 tempest-ProjectReaderTests-1754000686 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:33:24 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-f3127c58-1ef7-4ee3-ab15-d2337658f037 tempest-ProjectReaderTests-1754000686 None] Deleted volume successfully. Nov 03 08:33:24 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-f3127c58-1ef7-4ee3-ab15-d2337658f037 tempest-ProjectReaderTests-1754000686 None] Lock "cinder-326faf36-6bb0-46a6-9f86-3d0093023948-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Flow 'volume_create_manager' (5c6ae8e5-803c-4509-8c15-ee54e0b0dc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e8bff7-ad49-4d98-9398-8ee529132172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e8bff7-ad49-4d98-9398-8ee529132172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1640399287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78cca86e-73c8-4636-b9e9-a62b6e1cc775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0eecffb07e40e2813f1e25408d2790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:25Z,use_quota=True,user_id='c7249539ccb64caa9d422323a83818f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0d5c6d-6976-4848-92ac-d3e32dd55931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0d5c6d-6976-4848-92ac-d3e32dd55931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f104d2d-4f38-4d89-ad4d-438802db5bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f104d2d-4f38-4d89-ad4d-438802db5bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78cca86e-73c8-4636-b9e9-a62b6e1cc775', 'volume_name': 'volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f57a778-3fb5-484f-8843-6fb6dd710bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f57a778-3fb5-484f-8843-6fb6dd710bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5224c58b-138c-4138-895b-674861c7f28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:25 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Volume 78cca86e-73c8-4636-b9e9-a62b6e1cc775: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775', 'volume_size': 1} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1640399287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78cca86e-73c8-4636-b9e9-a62b6e1cc775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0eecffb07e40e2813f1e25408d2790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:25Z,use_quota=True,user_id='c7249539ccb64caa9d422323a83818f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Creating volume 78cca86e-73c8-4636-b9e9-a62b6e1cc775 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:33:25 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-12976192-aad3-49ec-bbd7-ec1a3f25a70c tempest-ProjectReaderTests-1056302893 None] Acquiring lock "cinder-c8c81beb-37b6-428a-abd2-2ecc99ab4587-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:25 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775 1073741824 Nov 03 08:33:25 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-12976192-aad3-49ec-bbd7-ec1a3f25a70c tempest-ProjectReaderTests-1056302893 None] Lock "cinder-c8c81beb-37b6-428a-abd2-2ecc99ab4587-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-12976192-aad3-49ec-bbd7-ec1a3f25a70c tempest-ProjectReaderTests-1056302893 None] Acquiring lock "cinder-quobyte-3ac34038-166b-464d-b090-7b648f6b043a" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-12976192-aad3-49ec-bbd7-ec1a3f25a70c tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-3ac34038-166b-464d-b090-7b648f6b043a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-12976192-aad3-49ec-bbd7-ec1a3f25a70c tempest-ProjectReaderTests-1056302893 None] Acquiring lock "cinder-quobyte-c8c81beb-37b6-428a-abd2-2ecc99ab4587" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-12976192-aad3-49ec-bbd7-ec1a3f25a70c tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-c8c81beb-37b6-428a-abd2-2ecc99ab4587" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-12976192-aad3-49ec-bbd7-ec1a3f25a70c tempest-ProjectReaderTests-1056302893 None] Deleting offline snapshot c8c81beb-37b6-428a-abd2-2ecc99ab4587 of volume 3ac34038-166b-464d-b090-7b648f6b043a {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-12976192-aad3-49ec-bbd7-ec1a3f25a70c tempest-ProjectReaderTests-1056302893 None] snapshot_file for this snap is: volume-3ac34038-166b-464d-b090-7b648f6b043a.c8c81beb-37b6-428a-abd2-2ecc99ab4587 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd48e33-1fd3-48f9-b68f-10535dfb3260]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-12976192-aad3-49ec-bbd7-ec1a3f25a70c tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a.c8c81beb-37b6-428a-abd2-2ecc99ab4587 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:25 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a.c8c81beb-37b6-428a-abd2-2ecc99ab4587 Nov 03 08:33:25 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:26 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775 1073741824" returned: 0 in 0.552s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:26 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-12976192-aad3-49ec-bbd7-ec1a3f25a70c tempest-ProjectReaderTests-1056302893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a.c8c81beb-37b6-428a-abd2-2ecc99ab4587" returned: 0 in 0.428s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:26 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-12976192-aad3-49ec-bbd7-ec1a3f25a70c tempest-ProjectReaderTests-1056302893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ac34038-166b-464d-b090-7b648f6b043a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:33:26 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f344817-87ec-49ec-94a3-2853b80e527f]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-12976192-aad3-49ec-bbd7-ec1a3f25a70c tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:26 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775 Nov 03 08:33:26 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:26 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a Nov 03 08:33:26 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:26 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775" returned: 0 in 0.337s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:26 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:33:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5224c58b-138c-4138-895b-674861c7f28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff355c43-7526-4988-8132-ffdbccb9ace1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:26 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Volume volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775 (78cca86e-73c8-4636-b9e9-a62b6e1cc775): created successfully Nov 03 08:33:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff355c43-7526-4988-8132-ffdbccb9ace1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:26 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Flow 'volume_create_manager' (5c6ae8e5-803c-4509-8c15-ee54e0b0dc8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:26 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-6268d70d-19ee-4e27-bef5-5b08def1a39a tempest-ProjectMemberTests-1074109481 None] Created volume successfully. Nov 03 08:33:26 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-12976192-aad3-49ec-bbd7-ec1a3f25a70c tempest-ProjectReaderTests-1056302893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a" returned: 0 in 0.559s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-12976192-aad3-49ec-bbd7-ec1a3f25a70c tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a.c8c81beb-37b6-428a-abd2-2ecc99ab4587 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:26 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a.c8c81beb-37b6-428a-abd2-2ecc99ab4587 Nov 03 08:33:26 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:27 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-12976192-aad3-49ec-bbd7-ec1a3f25a70c tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a.c8c81beb-37b6-428a-abd2-2ecc99ab4587" returned: 0 in 0.381s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-12976192-aad3-49ec-bbd7-ec1a3f25a70c tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a.c8c81beb-37b6-428a-abd2-2ecc99ab4587 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:27 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a.c8c81beb-37b6-428a-abd2-2ecc99ab4587 Nov 03 08:33:27 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:27 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-12976192-aad3-49ec-bbd7-ec1a3f25a70c tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a.c8c81beb-37b6-428a-abd2-2ecc99ab4587" returned: 0 in 0.302s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:27 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-12976192-aad3-49ec-bbd7-ec1a3f25a70c tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-c8c81beb-37b6-428a-abd2-2ecc99ab4587" released by "_delete_snapshot" :: held 1.800s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:27 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-12976192-aad3-49ec-bbd7-ec1a3f25a70c tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-3ac34038-166b-464d-b090-7b648f6b043a" released by "delete_snapshot" :: held 1.835s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:27 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-12976192-aad3-49ec-bbd7-ec1a3f25a70c tempest-ProjectReaderTests-1056302893 None] Created reservations ['8da48691-2928-4b33-a6db-1fd904b9ccc2', '54aae1f3-5b90-4890-9a5f-e6759d4e1628', 'b4f15908-ac6f-433c-ac6a-24c0bbe03947', 'cf59610a-3768-40f7-a2c4-6f18bfcf910c'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:33:27 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-12976192-aad3-49ec-bbd7-ec1a3f25a70c tempest-ProjectReaderTests-1056302893 None] Delete snapshot completed successfully. Nov 03 08:33:27 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-12976192-aad3-49ec-bbd7-ec1a3f25a70c tempest-ProjectReaderTests-1056302893 None] Lock "cinder-c8c81beb-37b6-428a-abd2-2ecc99ab4587-delete_snapshot" released by "delete_snapshot" :: held 2.040s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:27 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-083a7ecd-50eb-467a-95ef-4ddef9d7fb37 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "cinder-3ac34038-166b-464d-b090-7b648f6b043a-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:27 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-083a7ecd-50eb-467a-95ef-4ddef9d7fb37 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-3ac34038-166b-464d-b090-7b648f6b043a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:27 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-083a7ecd-50eb-467a-95ef-4ddef9d7fb37 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "cinder-quobyte-3ac34038-166b-464d-b090-7b648f6b043a" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:27 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-083a7ecd-50eb-467a-95ef-4ddef9d7fb37 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-3ac34038-166b-464d-b090-7b648f6b043a" acquired by "delete_volume" :: waited 0.029s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:27 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d113dd-1d38-4957-a9d9-76e243ca1914]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-083a7ecd-50eb-467a-95ef-4ddef9d7fb37 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:27 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a Nov 03 08:33:27 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-65d9ed8c-b641-4c4b-95af-c81d0044655c tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-65d9ed8c-b641-4c4b-95af-c81d0044655c tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-65d9ed8c-b641-4c4b-95af-c81d0044655c tempest-ProjectMemberTests-1074109481 None] Creating offline snapshot 355f996b-6add-4039-9252-38038d3d7f72 of volume 78cca86e-73c8-4636-b9e9-a62b6e1cc775 {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:33:28 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5e9cb6-1a7c-4939-863e-d474e962537c]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-65d9ed8c-b641-4c4b-95af-c81d0044655c tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:28 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-083a7ecd-50eb-467a-95ef-4ddef9d7fb37 tempest-ProjectReaderTests-1056302893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a" returned: 0 in 0.580s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-083a7ecd-50eb-467a-95ef-4ddef9d7fb37 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:28 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a Nov 03 08:33:28 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:28 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775 Nov 03 08:33:28 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:28 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-083a7ecd-50eb-467a-95ef-4ddef9d7fb37 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-3ac34038-166b-464d-b090-7b648f6b043a" returned: 0 in 0.255s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:28 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-083a7ecd-50eb-467a-95ef-4ddef9d7fb37 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-3ac34038-166b-464d-b090-7b648f6b043a" released by "delete_volume" :: held 0.924s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:28 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-083a7ecd-50eb-467a-95ef-4ddef9d7fb37 tempest-ProjectReaderTests-1056302893 None] Created reservations ['63123806-a730-41bf-a813-96311ca76b22', 'c6428aab-308e-4251-b7dd-7edf78b0bd62', 'e021af57-68cf-48b2-b9cf-c826acd032d5', 'b0cf281c-6025-4994-a324-a624ee3c038c'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:33:28 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-65d9ed8c-b641-4c4b-95af-c81d0044655c tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775" returned: 0 in 0.413s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-65d9ed8c-b641-4c4b-95af-c81d0044655c tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775.355f996b-6add-4039-9252-38038d3d7f72 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:28 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775.355f996b-6add-4039-9252-38038d3d7f72 1G Nov 03 08:33:28 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-083a7ecd-50eb-467a-95ef-4ddef9d7fb37 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-083a7ecd-50eb-467a-95ef-4ddef9d7fb37 tempest-ProjectReaderTests-1056302893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-083a7ecd-50eb-467a-95ef-4ddef9d7fb37 tempest-ProjectReaderTests-1056302893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:28 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-083a7ecd-50eb-467a-95ef-4ddef9d7fb37 tempest-ProjectReaderTests-1056302893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-083a7ecd-50eb-467a-95ef-4ddef9d7fb37 tempest-ProjectReaderTests-1056302893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-083a7ecd-50eb-467a-95ef-4ddef9d7fb37 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:28 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:33:28 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:29 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-083a7ecd-50eb-467a-95ef-4ddef9d7fb37 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.334s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:29 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-083a7ecd-50eb-467a-95ef-4ddef9d7fb37 tempest-ProjectReaderTests-1056302893 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:33:29 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-083a7ecd-50eb-467a-95ef-4ddef9d7fb37 tempest-ProjectReaderTests-1056302893 None] Deleted volume successfully. Nov 03 08:33:29 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-083a7ecd-50eb-467a-95ef-4ddef9d7fb37 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-3ac34038-166b-464d-b090-7b648f6b043a-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:29 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-65d9ed8c-b641-4c4b-95af-c81d0044655c tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775.355f996b-6add-4039-9252-38038d3d7f72 1G" returned: 0 in 0.590s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-65d9ed8c-b641-4c4b-95af-c81d0044655c tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775.355f996b-6add-4039-9252-38038d3d7f72 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:29 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775.355f996b-6add-4039-9252-38038d3d7f72 Nov 03 08:33:29 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:29 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:33:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Flow 'volume_create_manager' (dd2a9714-a660-4fe7-a048-ad6426876d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b828d7-385b-4876-b6f5-f246ef503021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b828d7-385b-4876-b6f5-f246ef503021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-558191917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8a8eb49c1b4829ae457fc94e4a2579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:29Z,use_quota=True,user_id='1d4001dc5c6a4c49afc6ca5d970aae8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9bc1e68-1b93-4fba-b2c8-3f657acf5e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9bc1e68-1b93-4fba-b2c8-3f657acf5e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1ab83f2-be64-4f83-9734-be0e0f62c38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1ab83f2-be64-4f83-9734-be0e0f62c38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785', 'volume_name': 'volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a5acaa-8428-4d47-af4e-cefc103aa54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a5acaa-8428-4d47-af4e-cefc103aa54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:29 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06293aba-1a3f-478a-a125-bb19d541fe39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:29 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Volume 1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785', 'volume_size': 1} Nov 03 08:33:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:29 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-65d9ed8c-b641-4c4b-95af-c81d0044655c tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775.355f996b-6add-4039-9252-38038d3d7f72" returned: 0 in 0.336s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:29 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-65d9ed8c-b641-4c4b-95af-c81d0044655c tempest-ProjectMemberTests-1074109481 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775.355f996b-6add-4039-9252-38038d3d7f72 is being set with open permissions: ugo+rw Nov 03 08:33:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-65d9ed8c-b641-4c4b-95af-c81d0044655c tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775.355f996b-6add-4039-9252-38038d3d7f72 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:29 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775.355f996b-6add-4039-9252-38038d3d7f72 Nov 03 08:33:29 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:29 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-65d9ed8c-b641-4c4b-95af-c81d0044655c tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775.355f996b-6add-4039-9252-38038d3d7f72" returned: 0 in 0.249s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-65d9ed8c-b641-4c4b-95af-c81d0044655c tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:30 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775.info Nov 03 08:33:30 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:30 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-65d9ed8c-b641-4c4b-95af-c81d0044655c tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775.info" returned: 0 in 0.258s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:30 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-65d9ed8c-b641-4c4b-95af-c81d0044655c tempest-ProjectMemberTests-1074109481 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775.info is being set with open permissions: ugo+rw Nov 03 08:33:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-65d9ed8c-b641-4c4b-95af-c81d0044655c tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:30 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775.info Nov 03 08:33:30 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:30 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-65d9ed8c-b641-4c4b-95af-c81d0044655c tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775.info" returned: 0 in 0.274s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-65d9ed8c-b641-4c4b-95af-c81d0044655c tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.236s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.957s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-558191917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8a8eb49c1b4829ae457fc94e4a2579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:29Z,use_quota=True,user_id='1d4001dc5c6a4c49afc6ca5d970aae8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:33:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Creating volume 1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:33:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:33:30 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:33:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:30 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785 1073741824 Nov 03 08:33:30 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:30 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-65d9ed8c-b641-4c4b-95af-c81d0044655c tempest-ProjectMemberTests-1074109481 None] Create snapshot completed successfully Nov 03 08:33:31 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785 1073741824" returned: 0 in 0.467s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:31 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785 Nov 03 08:33:31 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:31 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785" returned: 0 in 0.265s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:33:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06293aba-1a3f-478a-a125-bb19d541fe39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ccfd5de-af3c-4ca5-8bc0-f180898d31ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:31 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Volume volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785 (1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785): created successfully Nov 03 08:33:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ccfd5de-af3c-4ca5-8bc0-f180898d31ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Flow 'volume_create_manager' (dd2a9714-a660-4fe7-a048-ad6426876d27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:31 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-6baa474f-d572-4daf-b941-54122cf9d7e4 tempest-ProjectReaderTests-1056302893 None] Created volume successfully. Nov 03 08:33:31 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0e026bef-1850-47d6-8094-d8dfdb9758d8 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-355f996b-6add-4039-9252-38038d3d7f72-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:31 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0e026bef-1850-47d6-8094-d8dfdb9758d8 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-355f996b-6add-4039-9252-38038d3d7f72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:31 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0e026bef-1850-47d6-8094-d8dfdb9758d8 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-quobyte-78cca86e-73c8-4636-b9e9-a62b6e1cc775" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:31 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0e026bef-1850-47d6-8094-d8dfdb9758d8 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-78cca86e-73c8-4636-b9e9-a62b6e1cc775" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:31 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0e026bef-1850-47d6-8094-d8dfdb9758d8 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-quobyte-355f996b-6add-4039-9252-38038d3d7f72" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:31 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0e026bef-1850-47d6-8094-d8dfdb9758d8 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-355f996b-6add-4039-9252-38038d3d7f72" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-0e026bef-1850-47d6-8094-d8dfdb9758d8 tempest-ProjectMemberTests-1074109481 None] Deleting offline snapshot 355f996b-6add-4039-9252-38038d3d7f72 of volume 78cca86e-73c8-4636-b9e9-a62b6e1cc775 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:33:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-0e026bef-1850-47d6-8094-d8dfdb9758d8 tempest-ProjectMemberTests-1074109481 None] snapshot_file for this snap is: volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775.355f996b-6add-4039-9252-38038d3d7f72 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:33:31 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f68d91b-fa61-4298-9f95-319827c8b496]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0e026bef-1850-47d6-8094-d8dfdb9758d8 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775.355f996b-6add-4039-9252-38038d3d7f72 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:31 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775.355f996b-6add-4039-9252-38038d3d7f72 Nov 03 08:33:31 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f1cadb8e-b70c-4d16-a84c-52e713404b43 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f1cadb8e-b70c-4d16-a84c-52e713404b43 tempest-ProjectReaderTests-1056302893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-f1cadb8e-b70c-4d16-a84c-52e713404b43 tempest-ProjectReaderTests-1056302893 None] Creating offline snapshot 24029e3e-8ca7-4457-b702-b003d2bac637 of volume 1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785 {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:33:31 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf4b0d5-fb3e-4af4-bc53-ea2eef19a333]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f1cadb8e-b70c-4d16-a84c-52e713404b43 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:31 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785 Nov 03 08:33:31 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:32 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0e026bef-1850-47d6-8094-d8dfdb9758d8 tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775.355f996b-6add-4039-9252-38038d3d7f72" returned: 0 in 0.430s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:32 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-0e026bef-1850-47d6-8094-d8dfdb9758d8 tempest-ProjectMemberTests-1074109481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:33:32 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a6c50d-936b-44a4-b469-650af00ca417]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0e026bef-1850-47d6-8094-d8dfdb9758d8 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:32 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775 Nov 03 08:33:32 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:32 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f1cadb8e-b70c-4d16-a84c-52e713404b43 tempest-ProjectReaderTests-1056302893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785" returned: 0 in 0.420s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f1cadb8e-b70c-4d16-a84c-52e713404b43 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785.24029e3e-8ca7-4457-b702-b003d2bac637 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:32 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785.24029e3e-8ca7-4457-b702-b003d2bac637 1G Nov 03 08:33:32 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:32 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0e026bef-1850-47d6-8094-d8dfdb9758d8 tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775" returned: 0 in 0.427s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0e026bef-1850-47d6-8094-d8dfdb9758d8 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775.355f996b-6add-4039-9252-38038d3d7f72 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:32 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775.355f996b-6add-4039-9252-38038d3d7f72 Nov 03 08:33:32 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:32 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f1cadb8e-b70c-4d16-a84c-52e713404b43 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785.24029e3e-8ca7-4457-b702-b003d2bac637 1G" returned: 0 in 0.566s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f1cadb8e-b70c-4d16-a84c-52e713404b43 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785.24029e3e-8ca7-4457-b702-b003d2bac637 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:32 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785.24029e3e-8ca7-4457-b702-b003d2bac637 Nov 03 08:33:32 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:32 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0e026bef-1850-47d6-8094-d8dfdb9758d8 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775.355f996b-6add-4039-9252-38038d3d7f72" returned: 0 in 0.504s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0e026bef-1850-47d6-8094-d8dfdb9758d8 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775.355f996b-6add-4039-9252-38038d3d7f72 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:33 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775.355f996b-6add-4039-9252-38038d3d7f72 Nov 03 08:33:33 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:33 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f1cadb8e-b70c-4d16-a84c-52e713404b43 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785.24029e3e-8ca7-4457-b702-b003d2bac637" returned: 0 in 0.357s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:33 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-f1cadb8e-b70c-4d16-a84c-52e713404b43 tempest-ProjectReaderTests-1056302893 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785.24029e3e-8ca7-4457-b702-b003d2bac637 is being set with open permissions: ugo+rw Nov 03 08:33:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f1cadb8e-b70c-4d16-a84c-52e713404b43 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785.24029e3e-8ca7-4457-b702-b003d2bac637 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:33 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785.24029e3e-8ca7-4457-b702-b003d2bac637 Nov 03 08:33:33 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:33 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-0e026bef-1850-47d6-8094-d8dfdb9758d8 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775.355f996b-6add-4039-9252-38038d3d7f72" returned: 0 in 0.309s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0e026bef-1850-47d6-8094-d8dfdb9758d8 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-355f996b-6add-4039-9252-38038d3d7f72" released by "_delete_snapshot" :: held 1.834s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0e026bef-1850-47d6-8094-d8dfdb9758d8 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-78cca86e-73c8-4636-b9e9-a62b6e1cc775" released by "delete_snapshot" :: held 1.868s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:33 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-0e026bef-1850-47d6-8094-d8dfdb9758d8 tempest-ProjectMemberTests-1074109481 None] Created reservations ['a425c226-9810-4128-a58d-b56035ae59fa', '6c568eca-a7cd-4501-bb09-2a05d0a4c904', '2002a6ba-3b54-4bb0-839a-bbe07061983e', '29d30d7e-6fd6-4f7b-aa9d-4aaa95530d80'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:33:33 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f1cadb8e-b70c-4d16-a84c-52e713404b43 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785.24029e3e-8ca7-4457-b702-b003d2bac637" returned: 0 in 0.304s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:33 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-0e026bef-1850-47d6-8094-d8dfdb9758d8 tempest-ProjectMemberTests-1074109481 None] Delete snapshot completed successfully. Nov 03 08:33:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-0e026bef-1850-47d6-8094-d8dfdb9758d8 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-355f996b-6add-4039-9252-38038d3d7f72-delete_snapshot" released by "delete_snapshot" :: held 2.038s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f1cadb8e-b70c-4d16-a84c-52e713404b43 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:33 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785.info Nov 03 08:33:33 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-54915190-b2ac-4396-8d29-3d013886c634 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-78cca86e-73c8-4636-b9e9-a62b6e1cc775-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-54915190-b2ac-4396-8d29-3d013886c634 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-78cca86e-73c8-4636-b9e9-a62b6e1cc775-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-54915190-b2ac-4396-8d29-3d013886c634 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-quobyte-78cca86e-73c8-4636-b9e9-a62b6e1cc775" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:33 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-54915190-b2ac-4396-8d29-3d013886c634 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-78cca86e-73c8-4636-b9e9-a62b6e1cc775" acquired by "delete_volume" :: waited 0.023s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:33 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[978b8186-cc52-4a78-a4d6-7a5ea7dfefd8]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-54915190-b2ac-4396-8d29-3d013886c634 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:33 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f1cadb8e-b70c-4d16-a84c-52e713404b43 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785.info" returned: 0 in 0.309s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:33 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-f1cadb8e-b70c-4d16-a84c-52e713404b43 tempest-ProjectReaderTests-1056302893 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785.info is being set with open permissions: ugo+rw Nov 03 08:33:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f1cadb8e-b70c-4d16-a84c-52e713404b43 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:33 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785.info Nov 03 08:33:33 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:33 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775 Nov 03 08:33:33 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:34 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-f1cadb8e-b70c-4d16-a84c-52e713404b43 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785.info" returned: 0 in 0.257s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-f1cadb8e-b70c-4d16-a84c-52e713404b43 tempest-ProjectReaderTests-1056302893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.316s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:34 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-54915190-b2ac-4396-8d29-3d013886c634 tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775" returned: 0 in 0.392s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-54915190-b2ac-4396-8d29-3d013886c634 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:34 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-f1cadb8e-b70c-4d16-a84c-52e713404b43 tempest-ProjectReaderTests-1056302893 None] Create snapshot completed successfully Nov 03 08:33:34 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775 Nov 03 08:33:34 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:34 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-54915190-b2ac-4396-8d29-3d013886c634 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-78cca86e-73c8-4636-b9e9-a62b6e1cc775" returned: 0 in 0.305s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-54915190-b2ac-4396-8d29-3d013886c634 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-78cca86e-73c8-4636-b9e9-a62b6e1cc775" released by "delete_volume" :: held 0.765s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:34 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-54915190-b2ac-4396-8d29-3d013886c634 tempest-ProjectMemberTests-1074109481 None] Created reservations ['5b1aa448-720f-41a0-acb4-7891f1eeaac3', '5032f1a1-b58c-4f9c-be0f-5cb715bce904', 'aa0f1d56-239a-457f-bf80-a5253b6e63f1', 'aa08219d-0afe-47bd-9cd0-dd8b6a6ab76a'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:33:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-54915190-b2ac-4396-8d29-3d013886c634 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-54915190-b2ac-4396-8d29-3d013886c634 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:34 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-54915190-b2ac-4396-8d29-3d013886c634 tempest-ProjectMemberTests-1074109481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:34 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-54915190-b2ac-4396-8d29-3d013886c634 tempest-ProjectMemberTests-1074109481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-54915190-b2ac-4396-8d29-3d013886c634 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-54915190-b2ac-4396-8d29-3d013886c634 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:34 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:33:34 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:34 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-54915190-b2ac-4396-8d29-3d013886c634 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.266s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:34 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-54915190-b2ac-4396-8d29-3d013886c634 tempest-ProjectMemberTests-1074109481 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:33:34 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-54915190-b2ac-4396-8d29-3d013886c634 tempest-ProjectMemberTests-1074109481 None] Deleted volume successfully. Nov 03 08:33:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-54915190-b2ac-4396-8d29-3d013886c634 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-78cca86e-73c8-4636-b9e9-a62b6e1cc775-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-133d3f1d-2111-4da4-8fbd-833eb68f2941 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "cinder-24029e3e-8ca7-4457-b702-b003d2bac637-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-133d3f1d-2111-4da4-8fbd-833eb68f2941 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-24029e3e-8ca7-4457-b702-b003d2bac637-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-133d3f1d-2111-4da4-8fbd-833eb68f2941 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "cinder-quobyte-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-133d3f1d-2111-4da4-8fbd-833eb68f2941 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-133d3f1d-2111-4da4-8fbd-833eb68f2941 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "cinder-quobyte-24029e3e-8ca7-4457-b702-b003d2bac637" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-133d3f1d-2111-4da4-8fbd-833eb68f2941 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-24029e3e-8ca7-4457-b702-b003d2bac637" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-133d3f1d-2111-4da4-8fbd-833eb68f2941 tempest-ProjectReaderTests-1056302893 None] Deleting offline snapshot 24029e3e-8ca7-4457-b702-b003d2bac637 of volume 1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-133d3f1d-2111-4da4-8fbd-833eb68f2941 tempest-ProjectReaderTests-1056302893 None] snapshot_file for this snap is: volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785.24029e3e-8ca7-4457-b702-b003d2bac637 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0ffdac-a03a-4c90-b923-03d7fb13e010]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-133d3f1d-2111-4da4-8fbd-833eb68f2941 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785.24029e3e-8ca7-4457-b702-b003d2bac637 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:35 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785.24029e3e-8ca7-4457-b702-b003d2bac637 Nov 03 08:33:35 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Flow 'volume_create_manager' (88688bbe-2a3e-43c0-892d-d3e1f50ab1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50043bae-c521-4053-985c-9d0e05cbc700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50043bae-c521-4053-985c-9d0e05cbc700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-508129773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a48620ff-4a70-4a22-b4db-bbaf0fd69976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0eecffb07e40e2813f1e25408d2790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:35Z,use_quota=True,user_id='c7249539ccb64caa9d422323a83818f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (347e5094-b632-4e5b-809c-74621106a279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (347e5094-b632-4e5b-809c-74621106a279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42f782ea-beb6-4411-a4e9-f474c5ae5f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42f782ea-beb6-4411-a4e9-f474c5ae5f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a48620ff-4a70-4a22-b4db-bbaf0fd69976', 'volume_name': 'volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac3f6f2-cb01-4504-b219-a93bec08d1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac3f6f2-cb01-4504-b219-a93bec08d1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1507249-ca6e-421c-8469-331084b774e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:35 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Volume a48620ff-4a70-4a22-b4db-bbaf0fd69976: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976', 'volume_size': 1} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-508129773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a48620ff-4a70-4a22-b4db-bbaf0fd69976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0eecffb07e40e2813f1e25408d2790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:35Z,use_quota=True,user_id='c7249539ccb64caa9d422323a83818f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Creating volume a48620ff-4a70-4a22-b4db-bbaf0fd69976 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:33:35 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:35 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976 1073741824 Nov 03 08:33:35 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:35 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-133d3f1d-2111-4da4-8fbd-833eb68f2941 tempest-ProjectReaderTests-1056302893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785.24029e3e-8ca7-4457-b702-b003d2bac637" returned: 0 in 0.412s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-133d3f1d-2111-4da4-8fbd-833eb68f2941 tempest-ProjectReaderTests-1056302893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dc3b7e-6af3-4add-9ce6-620aaa311086]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-133d3f1d-2111-4da4-8fbd-833eb68f2941 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:35 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785 Nov 03 08:33:35 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:35 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976 1073741824" returned: 0 in 0.465s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:36 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976 Nov 03 08:33:36 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:36 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-133d3f1d-2111-4da4-8fbd-833eb68f2941 tempest-ProjectReaderTests-1056302893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785" returned: 0 in 0.426s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-133d3f1d-2111-4da4-8fbd-833eb68f2941 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785.24029e3e-8ca7-4457-b702-b003d2bac637 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:36 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785.24029e3e-8ca7-4457-b702-b003d2bac637 Nov 03 08:33:36 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:36 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976" returned: 0 in 0.286s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:36 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:33:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1507249-ca6e-421c-8469-331084b774e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc54cc8d-8604-4399-b0d8-7c27fca220a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:36 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Volume volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976 (a48620ff-4a70-4a22-b4db-bbaf0fd69976): created successfully Nov 03 08:33:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc54cc8d-8604-4399-b0d8-7c27fca220a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:36 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Flow 'volume_create_manager' (88688bbe-2a3e-43c0-892d-d3e1f50ab1ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:36 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-54ade701-3524-4032-92c4-363a1439e12f tempest-ProjectMemberTests-1074109481 None] Created volume successfully. Nov 03 08:33:36 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-133d3f1d-2111-4da4-8fbd-833eb68f2941 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785.24029e3e-8ca7-4457-b702-b003d2bac637" returned: 0 in 0.456s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-133d3f1d-2111-4da4-8fbd-833eb68f2941 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785.24029e3e-8ca7-4457-b702-b003d2bac637 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:36 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785.24029e3e-8ca7-4457-b702-b003d2bac637 Nov 03 08:33:36 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:36 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-133d3f1d-2111-4da4-8fbd-833eb68f2941 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785.24029e3e-8ca7-4457-b702-b003d2bac637" returned: 0 in 0.263s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-133d3f1d-2111-4da4-8fbd-833eb68f2941 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-24029e3e-8ca7-4457-b702-b003d2bac637" released by "_delete_snapshot" :: held 1.704s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-133d3f1d-2111-4da4-8fbd-833eb68f2941 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785" released by "delete_snapshot" :: held 1.737s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:36 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-133d3f1d-2111-4da4-8fbd-833eb68f2941 tempest-ProjectReaderTests-1056302893 None] Created reservations ['428eccd0-7612-43d2-b2bf-5d7080c04018', 'f5dbc79f-fe57-40da-9a81-ca5701a00d23', '882f277d-f356-412a-a8ea-44b652f697ff', '3631e8a8-eeb5-44c3-bff7-4b50e16d5689'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:33:36 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-133d3f1d-2111-4da4-8fbd-833eb68f2941 tempest-ProjectReaderTests-1056302893 None] Delete snapshot completed successfully. Nov 03 08:33:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-133d3f1d-2111-4da4-8fbd-833eb68f2941 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-24029e3e-8ca7-4457-b702-b003d2bac637-delete_snapshot" released by "delete_snapshot" :: held 1.889s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-101ee6f8-c7a3-4399-ba48-688593283bbd tempest-ProjectReaderTests-1056302893 None] Acquiring lock "cinder-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-101ee6f8-c7a3-4399-ba48-688593283bbd tempest-ProjectReaderTests-1056302893 None] Lock "cinder-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-101ee6f8-c7a3-4399-ba48-688593283bbd tempest-ProjectReaderTests-1056302893 None] Acquiring lock "cinder-quobyte-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-101ee6f8-c7a3-4399-ba48-688593283bbd tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785" acquired by "delete_volume" :: waited 0.023s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:37 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1aee97-90d4-4f06-8d56-9ae243a351b8]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-101ee6f8-c7a3-4399-ba48-688593283bbd tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:37 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785 Nov 03 08:33:37 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1d439e7b-51ba-4482-b781-d4da749a1d61 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1d439e7b-51ba-4482-b781-d4da749a1d61 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-1d439e7b-51ba-4482-b781-d4da749a1d61 tempest-ProjectMemberTests-1074109481 None] Creating offline snapshot 15755288-52c4-453d-ba3b-b948fbf158f6 of volume a48620ff-4a70-4a22-b4db-bbaf0fd69976 {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:33:37 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74b4a07-d0ae-4fea-8cac-990df4143fb0]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1d439e7b-51ba-4482-b781-d4da749a1d61 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:37 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-101ee6f8-c7a3-4399-ba48-688593283bbd tempest-ProjectReaderTests-1056302893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785" returned: 0 in 0.505s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-101ee6f8-c7a3-4399-ba48-688593283bbd tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:37 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976 Nov 03 08:33:37 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:37 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785 Nov 03 08:33:37 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:38 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-101ee6f8-c7a3-4399-ba48-688593283bbd tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785" returned: 0 in 0.254s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-101ee6f8-c7a3-4399-ba48-688593283bbd tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785" released by "delete_volume" :: held 0.837s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:38 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1d439e7b-51ba-4482-b781-d4da749a1d61 tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976" returned: 0 in 0.417s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1d439e7b-51ba-4482-b781-d4da749a1d61 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976.15755288-52c4-453d-ba3b-b948fbf158f6 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:38 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976.15755288-52c4-453d-ba3b-b948fbf158f6 1G Nov 03 08:33:38 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:38 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-101ee6f8-c7a3-4399-ba48-688593283bbd tempest-ProjectReaderTests-1056302893 None] Created reservations ['2de82724-eadd-4a0d-9112-40fe2e24dd06', '30ae37dd-b3ef-4342-9bed-a81d2527017f', 'c967226f-3031-4026-b8ad-64e73c330f31', 'e2b38822-1449-4bbe-969c-e7961667d62b'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:33:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-101ee6f8-c7a3-4399-ba48-688593283bbd tempest-ProjectReaderTests-1056302893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-101ee6f8-c7a3-4399-ba48-688593283bbd tempest-ProjectReaderTests-1056302893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-101ee6f8-c7a3-4399-ba48-688593283bbd tempest-ProjectReaderTests-1056302893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-101ee6f8-c7a3-4399-ba48-688593283bbd tempest-ProjectReaderTests-1056302893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-101ee6f8-c7a3-4399-ba48-688593283bbd tempest-ProjectReaderTests-1056302893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-101ee6f8-c7a3-4399-ba48-688593283bbd tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:38 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:33:38 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:38 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-101ee6f8-c7a3-4399-ba48-688593283bbd tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.302s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:38 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-101ee6f8-c7a3-4399-ba48-688593283bbd tempest-ProjectReaderTests-1056302893 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:33:38 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-101ee6f8-c7a3-4399-ba48-688593283bbd tempest-ProjectReaderTests-1056302893 None] Deleted volume successfully. Nov 03 08:33:38 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-101ee6f8-c7a3-4399-ba48-688593283bbd tempest-ProjectReaderTests-1056302893 None] Lock "cinder-1fbd0fe8-6ed7-46a5-91fc-8f652a2d5785-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:38 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1d439e7b-51ba-4482-b781-d4da749a1d61 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976.15755288-52c4-453d-ba3b-b948fbf158f6 1G" returned: 0 in 0.494s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1d439e7b-51ba-4482-b781-d4da749a1d61 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976.15755288-52c4-453d-ba3b-b948fbf158f6 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:38 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976.15755288-52c4-453d-ba3b-b948fbf158f6 Nov 03 08:33:38 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:38 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:33:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Flow 'volume_create_manager' (aa8ab76d-85d1-4a90-b7a6-982bc0350b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e84e01af-1b5c-46c2-8001-59152c2635f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e84e01af-1b5c-46c2-8001-59152c2635f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1571055218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8afc095d-e26d-4f67-afd2-480d918a8ead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8a8eb49c1b4829ae457fc94e4a2579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:39Z,use_quota=True,user_id='1d4001dc5c6a4c49afc6ca5d970aae8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f62fd4d-a702-4ce6-9797-9541f070ee58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:38 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f62fd4d-a702-4ce6-9797-9541f070ee58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ab7c7d-4c0f-49d8-91db-97b16662d494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ab7c7d-4c0f-49d8-91db-97b16662d494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8afc095d-e26d-4f67-afd2-480d918a8ead', 'volume_name': 'volume-8afc095d-e26d-4f67-afd2-480d918a8ead', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e86c418-45e0-4293-a249-0e9af2cb1ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e86c418-45e0-4293-a249-0e9af2cb1ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d2a8065-37fa-423d-a184-776ff21b2c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:39 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Volume 8afc095d-e26d-4f67-afd2-480d918a8ead: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8afc095d-e26d-4f67-afd2-480d918a8ead', 'volume_size': 1} Nov 03 08:33:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1d439e7b-51ba-4482-b781-d4da749a1d61 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976.15755288-52c4-453d-ba3b-b948fbf158f6" returned: 0 in 0.388s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:39 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-1d439e7b-51ba-4482-b781-d4da749a1d61 tempest-ProjectMemberTests-1074109481 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976.15755288-52c4-453d-ba3b-b948fbf158f6 is being set with open permissions: ugo+rw Nov 03 08:33:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1d439e7b-51ba-4482-b781-d4da749a1d61 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976.15755288-52c4-453d-ba3b-b948fbf158f6 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:39 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976.15755288-52c4-453d-ba3b-b948fbf158f6 Nov 03 08:33:39 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:39 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1d439e7b-51ba-4482-b781-d4da749a1d61 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976.15755288-52c4-453d-ba3b-b948fbf158f6" returned: 0 in 0.246s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1d439e7b-51ba-4482-b781-d4da749a1d61 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:39 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976.info Nov 03 08:33:39 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:39 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1d439e7b-51ba-4482-b781-d4da749a1d61 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976.info" returned: 0 in 0.246s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:39 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-1d439e7b-51ba-4482-b781-d4da749a1d61 tempest-ProjectMemberTests-1074109481 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976.info is being set with open permissions: ugo+rw Nov 03 08:33:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1d439e7b-51ba-4482-b781-d4da749a1d61 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:39 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976.info Nov 03 08:33:39 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:39 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1d439e7b-51ba-4482-b781-d4da749a1d61 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976.info" returned: 0 in 0.248s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1d439e7b-51ba-4482-b781-d4da749a1d61 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.135s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.792s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:39 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1571055218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8afc095d-e26d-4f67-afd2-480d918a8ead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8a8eb49c1b4829ae457fc94e4a2579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:39Z,use_quota=True,user_id='1d4001dc5c6a4c49afc6ca5d970aae8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:33:39 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Creating volume 8afc095d-e26d-4f67-afd2-480d918a8ead {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:33:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:39 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:39 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:39 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:33:39 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:33:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:39 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead 1073741824 Nov 03 08:33:39 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:39 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-1d439e7b-51ba-4482-b781-d4da749a1d61 tempest-ProjectMemberTests-1074109481 None] Create snapshot completed successfully Nov 03 08:33:40 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead 1073741824" returned: 0 in 0.544s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:40 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead Nov 03 08:33:40 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:40 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead" returned: 0 in 0.260s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:33:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:40 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d2a8065-37fa-423d-a184-776ff21b2c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8afc095d-e26d-4f67-afd2-480d918a8ead', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:40 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f10b150-654e-447f-b056-483226b92cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:40 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Volume volume-8afc095d-e26d-4f67-afd2-480d918a8ead (8afc095d-e26d-4f67-afd2-480d918a8ead): created successfully Nov 03 08:33:40 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f10b150-654e-447f-b056-483226b92cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:40 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Flow 'volume_create_manager' (aa8ab76d-85d1-4a90-b7a6-982bc0350b78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:40 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-5261d174-93e1-414d-9699-a2790313a7e7 tempest-ProjectReaderTests-1056302893 None] Created volume successfully. Nov 03 08:33:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-80ab12af-cd51-4050-8cda-6582a0d9ff12 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-15755288-52c4-453d-ba3b-b948fbf158f6-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-80ab12af-cd51-4050-8cda-6582a0d9ff12 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-15755288-52c4-453d-ba3b-b948fbf158f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-80ab12af-cd51-4050-8cda-6582a0d9ff12 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-quobyte-a48620ff-4a70-4a22-b4db-bbaf0fd69976" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-80ab12af-cd51-4050-8cda-6582a0d9ff12 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-a48620ff-4a70-4a22-b4db-bbaf0fd69976" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-80ab12af-cd51-4050-8cda-6582a0d9ff12 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-quobyte-15755288-52c4-453d-ba3b-b948fbf158f6" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:40 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-80ab12af-cd51-4050-8cda-6582a0d9ff12 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-15755288-52c4-453d-ba3b-b948fbf158f6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-80ab12af-cd51-4050-8cda-6582a0d9ff12 tempest-ProjectMemberTests-1074109481 None] Deleting offline snapshot 15755288-52c4-453d-ba3b-b948fbf158f6 of volume a48620ff-4a70-4a22-b4db-bbaf0fd69976 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:33:40 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-80ab12af-cd51-4050-8cda-6582a0d9ff12 tempest-ProjectMemberTests-1074109481 None] snapshot_file for this snap is: volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976.15755288-52c4-453d-ba3b-b948fbf158f6 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:33:40 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[6534cacd-4f80-4544-96f7-ba1829120084]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-80ab12af-cd51-4050-8cda-6582a0d9ff12 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976.15755288-52c4-453d-ba3b-b948fbf158f6 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:41 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976.15755288-52c4-453d-ba3b-b948fbf158f6 Nov 03 08:33:41 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7a9b2544-17f9-4329-86ce-c5d2027c2b6e tempest-ProjectReaderTests-1056302893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7a9b2544-17f9-4329-86ce-c5d2027c2b6e tempest-ProjectReaderTests-1056302893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-7a9b2544-17f9-4329-86ce-c5d2027c2b6e tempest-ProjectReaderTests-1056302893 None] Creating offline snapshot 33026574-1fcd-4d8d-8a94-5ed0335a2bbe of volume 8afc095d-e26d-4f67-afd2-480d918a8ead {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:33:41 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5e4bf4-8b4b-4e85-a111-adbf70dcf4f8]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7a9b2544-17f9-4329-86ce-c5d2027c2b6e tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:41 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-80ab12af-cd51-4050-8cda-6582a0d9ff12 tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976.15755288-52c4-453d-ba3b-b948fbf158f6" returned: 0 in 0.451s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-80ab12af-cd51-4050-8cda-6582a0d9ff12 tempest-ProjectMemberTests-1074109481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:33:41 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c2fb1a-fbd5-4814-980f-35de6ff7d883]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-80ab12af-cd51-4050-8cda-6582a0d9ff12 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:41 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead Nov 03 08:33:41 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:41 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976 Nov 03 08:33:41 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:41 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7a9b2544-17f9-4329-86ce-c5d2027c2b6e tempest-ProjectReaderTests-1056302893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead" returned: 0 in 0.392s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7a9b2544-17f9-4329-86ce-c5d2027c2b6e tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead.33026574-1fcd-4d8d-8a94-5ed0335a2bbe 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:41 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead.33026574-1fcd-4d8d-8a94-5ed0335a2bbe 1G Nov 03 08:33:41 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:41 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-80ab12af-cd51-4050-8cda-6582a0d9ff12 tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976" returned: 0 in 0.399s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-80ab12af-cd51-4050-8cda-6582a0d9ff12 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976.15755288-52c4-453d-ba3b-b948fbf158f6 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:41 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976.15755288-52c4-453d-ba3b-b948fbf158f6 Nov 03 08:33:41 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:42 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7a9b2544-17f9-4329-86ce-c5d2027c2b6e tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead.33026574-1fcd-4d8d-8a94-5ed0335a2bbe 1G" returned: 0 in 0.469s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7a9b2544-17f9-4329-86ce-c5d2027c2b6e tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8afc095d-e26d-4f67-afd2-480d918a8ead -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead.33026574-1fcd-4d8d-8a94-5ed0335a2bbe {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:42 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-80ab12af-cd51-4050-8cda-6582a0d9ff12 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976.15755288-52c4-453d-ba3b-b948fbf158f6" returned: 0 in 0.381s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-80ab12af-cd51-4050-8cda-6582a0d9ff12 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976.15755288-52c4-453d-ba3b-b948fbf158f6 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:42 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8afc095d-e26d-4f67-afd2-480d918a8ead -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead.33026574-1fcd-4d8d-8a94-5ed0335a2bbe Nov 03 08:33:42 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:42 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976.15755288-52c4-453d-ba3b-b948fbf158f6 Nov 03 08:33:42 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:42 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-80ab12af-cd51-4050-8cda-6582a0d9ff12 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976.15755288-52c4-453d-ba3b-b948fbf158f6" returned: 0 in 0.302s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:42 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-80ab12af-cd51-4050-8cda-6582a0d9ff12 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-15755288-52c4-453d-ba3b-b948fbf158f6" released by "_delete_snapshot" :: held 1.671s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7a9b2544-17f9-4329-86ce-c5d2027c2b6e tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8afc095d-e26d-4f67-afd2-480d918a8ead -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead.33026574-1fcd-4d8d-8a94-5ed0335a2bbe" returned: 0 in 0.381s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:42 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-7a9b2544-17f9-4329-86ce-c5d2027c2b6e tempest-ProjectReaderTests-1056302893 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead.33026574-1fcd-4d8d-8a94-5ed0335a2bbe is being set with open permissions: ugo+rw Nov 03 08:33:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7a9b2544-17f9-4329-86ce-c5d2027c2b6e tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead.33026574-1fcd-4d8d-8a94-5ed0335a2bbe {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-80ab12af-cd51-4050-8cda-6582a0d9ff12 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-a48620ff-4a70-4a22-b4db-bbaf0fd69976" released by "delete_snapshot" :: held 1.706s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:42 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead.33026574-1fcd-4d8d-8a94-5ed0335a2bbe Nov 03 08:33:42 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:42 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-80ab12af-cd51-4050-8cda-6582a0d9ff12 tempest-ProjectMemberTests-1074109481 None] Created reservations ['1dc30f3d-37ab-4b75-b9c1-fe57abb200dd', '886765b8-e997-49b4-afa2-6c8d626f34d3', 'df27a866-3289-4758-8974-ee4cf9c02009', 'a7269127-8718-45a9-9c09-faeb4e0fc943'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:33:42 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-80ab12af-cd51-4050-8cda-6582a0d9ff12 tempest-ProjectMemberTests-1074109481 None] Delete snapshot completed successfully. Nov 03 08:33:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-80ab12af-cd51-4050-8cda-6582a0d9ff12 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-15755288-52c4-453d-ba3b-b948fbf158f6-delete_snapshot" released by "delete_snapshot" :: held 1.876s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:42 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7a9b2544-17f9-4329-86ce-c5d2027c2b6e tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead.33026574-1fcd-4d8d-8a94-5ed0335a2bbe" returned: 0 in 0.300s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7a9b2544-17f9-4329-86ce-c5d2027c2b6e tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:42 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead.info Nov 03 08:33:42 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-666ceab6-7a7e-4361-8d77-8b4ac8c911fd tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-a48620ff-4a70-4a22-b4db-bbaf0fd69976-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-666ceab6-7a7e-4361-8d77-8b4ac8c911fd tempest-ProjectMemberTests-1074109481 None] Lock "cinder-a48620ff-4a70-4a22-b4db-bbaf0fd69976-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-666ceab6-7a7e-4361-8d77-8b4ac8c911fd tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-quobyte-a48620ff-4a70-4a22-b4db-bbaf0fd69976" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-666ceab6-7a7e-4361-8d77-8b4ac8c911fd tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-a48620ff-4a70-4a22-b4db-bbaf0fd69976" acquired by "delete_volume" :: waited 0.023s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:43 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7a9b2544-17f9-4329-86ce-c5d2027c2b6e tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead.info" returned: 0 in 0.331s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:43 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-7a9b2544-17f9-4329-86ce-c5d2027c2b6e tempest-ProjectReaderTests-1056302893 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead.info is being set with open permissions: ugo+rw Nov 03 08:33:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7a9b2544-17f9-4329-86ce-c5d2027c2b6e tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:43 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b7663f-22bf-458c-b738-4b7ba822eea3]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-666ceab6-7a7e-4361-8d77-8b4ac8c911fd tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:43 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead.info Nov 03 08:33:43 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:43 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976 Nov 03 08:33:43 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:43 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-7a9b2544-17f9-4329-86ce-c5d2027c2b6e tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead.info" returned: 0 in 0.391s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-7a9b2544-17f9-4329-86ce-c5d2027c2b6e tempest-ProjectReaderTests-1056302893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.366s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:43 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-666ceab6-7a7e-4361-8d77-8b4ac8c911fd tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976" returned: 0 in 0.413s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-666ceab6-7a7e-4361-8d77-8b4ac8c911fd tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:43 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-7a9b2544-17f9-4329-86ce-c5d2027c2b6e tempest-ProjectReaderTests-1056302893 None] Create snapshot completed successfully Nov 03 08:33:43 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976 Nov 03 08:33:43 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:43 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-666ceab6-7a7e-4361-8d77-8b4ac8c911fd tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-a48620ff-4a70-4a22-b4db-bbaf0fd69976" returned: 0 in 0.278s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-666ceab6-7a7e-4361-8d77-8b4ac8c911fd tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-a48620ff-4a70-4a22-b4db-bbaf0fd69976" released by "delete_volume" :: held 0.785s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:43 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-666ceab6-7a7e-4361-8d77-8b4ac8c911fd tempest-ProjectMemberTests-1074109481 None] Created reservations ['211a6637-f16b-493f-9870-22ec7c101bd0', '8a6623ff-d7c9-4831-807b-f2aee0f5d00a', 'c9459add-0418-4944-9309-aa8527ab702c', 'c9c7c254-8c66-4d60-96bf-18e5ecddb0ec'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:33:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-666ceab6-7a7e-4361-8d77-8b4ac8c911fd tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-666ceab6-7a7e-4361-8d77-8b4ac8c911fd tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:44 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-666ceab6-7a7e-4361-8d77-8b4ac8c911fd tempest-ProjectMemberTests-1074109481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:44 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-666ceab6-7a7e-4361-8d77-8b4ac8c911fd tempest-ProjectMemberTests-1074109481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-666ceab6-7a7e-4361-8d77-8b4ac8c911fd tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-666ceab6-7a7e-4361-8d77-8b4ac8c911fd tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:44 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:33:44 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:44 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-666ceab6-7a7e-4361-8d77-8b4ac8c911fd tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.309s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:44 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-666ceab6-7a7e-4361-8d77-8b4ac8c911fd tempest-ProjectMemberTests-1074109481 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:33:44 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-666ceab6-7a7e-4361-8d77-8b4ac8c911fd tempest-ProjectMemberTests-1074109481 None] Deleted volume successfully. Nov 03 08:33:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-666ceab6-7a7e-4361-8d77-8b4ac8c911fd tempest-ProjectMemberTests-1074109481 None] Lock "cinder-a48620ff-4a70-4a22-b4db-bbaf0fd69976-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-dcb259eb-b69e-486e-9643-506ad6b89275 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "cinder-33026574-1fcd-4d8d-8a94-5ed0335a2bbe-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-dcb259eb-b69e-486e-9643-506ad6b89275 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-33026574-1fcd-4d8d-8a94-5ed0335a2bbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-dcb259eb-b69e-486e-9643-506ad6b89275 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "cinder-quobyte-8afc095d-e26d-4f67-afd2-480d918a8ead" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-dcb259eb-b69e-486e-9643-506ad6b89275 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-8afc095d-e26d-4f67-afd2-480d918a8ead" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-dcb259eb-b69e-486e-9643-506ad6b89275 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "cinder-quobyte-33026574-1fcd-4d8d-8a94-5ed0335a2bbe" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-dcb259eb-b69e-486e-9643-506ad6b89275 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-33026574-1fcd-4d8d-8a94-5ed0335a2bbe" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:44 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-dcb259eb-b69e-486e-9643-506ad6b89275 tempest-ProjectReaderTests-1056302893 None] Deleting offline snapshot 33026574-1fcd-4d8d-8a94-5ed0335a2bbe of volume 8afc095d-e26d-4f67-afd2-480d918a8ead {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:33:44 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-dcb259eb-b69e-486e-9643-506ad6b89275 tempest-ProjectReaderTests-1056302893 None] snapshot_file for this snap is: volume-8afc095d-e26d-4f67-afd2-480d918a8ead.33026574-1fcd-4d8d-8a94-5ed0335a2bbe {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:33:44 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6f9fee-ce0a-4c9b-b42e-4be853a22a4f]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-dcb259eb-b69e-486e-9643-506ad6b89275 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead.33026574-1fcd-4d8d-8a94-5ed0335a2bbe {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:44 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead.33026574-1fcd-4d8d-8a94-5ed0335a2bbe Nov 03 08:33:44 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:44 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:33:44 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Flow 'volume_create_manager' (0afb050b-8aec-4f34-9608-2cd3ba789c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:44 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (618bbe08-49f4-4234-96a8-933cfc3b707c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:44 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (618bbe08-49f4-4234-96a8-933cfc3b707c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-303988750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7261d7-0460-43f2-8361-d568a620a0cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0eecffb07e40e2813f1e25408d2790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:45Z,use_quota=True,user_id='c7249539ccb64caa9d422323a83818f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:44 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e9bd01-d2c0-4934-b88f-e59d284b6ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e9bd01-d2c0-4934-b88f-e59d284b6ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc1c2a4-2421-4a50-a67e-291557f7b7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc1c2a4-2421-4a50-a67e-291557f7b7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db7261d7-0460-43f2-8361-d568a620a0cf', 'volume_name': 'volume-db7261d7-0460-43f2-8361-d568a620a0cf', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc22b357-8c49-4e8e-ba62-cc43ff5ff2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc22b357-8c49-4e8e-ba62-cc43ff5ff2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab49d19-3804-40d0-95e8-3738c9603ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:45 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Volume db7261d7-0460-43f2-8361-d568a620a0cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db7261d7-0460-43f2-8361-d568a620a0cf', 'volume_size': 1} Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-303988750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7261d7-0460-43f2-8361-d568a620a0cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0eecffb07e40e2813f1e25408d2790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:45Z,use_quota=True,user_id='c7249539ccb64caa9d422323a83818f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Creating volume db7261d7-0460-43f2-8361-d568a620a0cf {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:33:45 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:45 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf 1073741824 Nov 03 08:33:45 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:45 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-dcb259eb-b69e-486e-9643-506ad6b89275 tempest-ProjectReaderTests-1056302893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead.33026574-1fcd-4d8d-8a94-5ed0335a2bbe" returned: 0 in 0.479s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-dcb259eb-b69e-486e-9643-506ad6b89275 tempest-ProjectReaderTests-1056302893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8afc095d-e26d-4f67-afd2-480d918a8ead(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd85daf-034f-4b8d-81ce-a4c5746e84f6]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-dcb259eb-b69e-486e-9643-506ad6b89275 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:45 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead Nov 03 08:33:45 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:45 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf 1073741824" returned: 0 in 0.614s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:45 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-dcb259eb-b69e-486e-9643-506ad6b89275 tempest-ProjectReaderTests-1056302893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead" returned: 0 in 0.537s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-dcb259eb-b69e-486e-9643-506ad6b89275 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead.33026574-1fcd-4d8d-8a94-5ed0335a2bbe {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:45 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf Nov 03 08:33:45 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:45 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead.33026574-1fcd-4d8d-8a94-5ed0335a2bbe Nov 03 08:33:45 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:45 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf" returned: 0 in 0.261s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab49d19-3804-40d0-95e8-3738c9603ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db7261d7-0460-43f2-8361-d568a620a0cf', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:45 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45562dce-c04a-4134-9236-e43b60130984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:45 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Volume volume-db7261d7-0460-43f2-8361-d568a620a0cf (db7261d7-0460-43f2-8361-d568a620a0cf): created successfully Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45562dce-c04a-4134-9236-e43b60130984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Flow 'volume_create_manager' (0afb050b-8aec-4f34-9608-2cd3ba789c20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:46 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-71a0cef3-4fb5-4330-8c84-46c82100de76 tempest-ProjectMemberTests-1074109481 None] Created volume successfully. Nov 03 08:33:46 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-dcb259eb-b69e-486e-9643-506ad6b89275 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead.33026574-1fcd-4d8d-8a94-5ed0335a2bbe" returned: 0 in 0.398s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-dcb259eb-b69e-486e-9643-506ad6b89275 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead.33026574-1fcd-4d8d-8a94-5ed0335a2bbe {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:46 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead.33026574-1fcd-4d8d-8a94-5ed0335a2bbe Nov 03 08:33:46 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:46 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-dcb259eb-b69e-486e-9643-506ad6b89275 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead.33026574-1fcd-4d8d-8a94-5ed0335a2bbe" returned: 0 in 0.264s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Flow 'volume_create_manager' (371700b5-6504-4005-bd32-17b44e534f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a608f645-5499-4434-9244-d40b0b2dbbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-dcb259eb-b69e-486e-9643-506ad6b89275 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-33026574-1fcd-4d8d-8a94-5ed0335a2bbe" released by "_delete_snapshot" :: held 1.869s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-dcb259eb-b69e-486e-9643-506ad6b89275 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-8afc095d-e26d-4f67-afd2-480d918a8ead" released by "delete_snapshot" :: held 1.909s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a608f645-5499-4434-9244-d40b0b2dbbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1838532754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88cd57e1-3a7d-4729-ba2e-f74a9b383009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323bb4837e244c3db0f43d01b6a57314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:46Z,use_quota=True,user_id='f0d71b144add48dfa0b98ec9fcd4a39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2ba7095-470f-4562-9eb3-71e0b2a5fa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2ba7095-470f-4562-9eb3-71e0b2a5fa27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e88ad9-d63b-4ccc-91e9-250a4920fd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e88ad9-d63b-4ccc-91e9-250a4920fd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88cd57e1-3a7d-4729-ba2e-f74a9b383009', 'volume_name': 'volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39741bb6-693b-4652-96c0-09a3d348560d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39741bb6-693b-4652-96c0-09a3d348560d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb01eeb1-ca61-44fe-9ebc-f78981bba9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:46 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Volume 88cd57e1-3a7d-4729-ba2e-f74a9b383009: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009', 'volume_size': 1} Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1838532754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88cd57e1-3a7d-4729-ba2e-f74a9b383009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323bb4837e244c3db0f43d01b6a57314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:46Z,use_quota=True,user_id='f0d71b144add48dfa0b98ec9fcd4a39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Creating volume 88cd57e1-3a7d-4729-ba2e-f74a9b383009 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:33:46 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:46 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009 1073741824 Nov 03 08:33:46 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-dcb259eb-b69e-486e-9643-506ad6b89275 tempest-ProjectReaderTests-1056302893 None] Created reservations ['ba00fa03-aa98-46d2-ba22-699bbc7fa3d4', 'c38e7349-27d2-4dc3-97ff-491c63fa2344', 'c4782a46-d11e-42e8-aa14-bda86c903efa', 'd48f503b-9669-4745-9d4c-7a048bcfbd58'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:33:46 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-dcb259eb-b69e-486e-9643-506ad6b89275 tempest-ProjectReaderTests-1056302893 None] Delete snapshot completed successfully. Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-dcb259eb-b69e-486e-9643-506ad6b89275 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-33026574-1fcd-4d8d-8a94-5ed0335a2bbe-delete_snapshot" released by "delete_snapshot" :: held 2.115s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:46 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009 1073741824" returned: 0 in 0.422s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:46 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:46 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009 Nov 03 08:33:46 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-71b266c3-d5ab-494a-b3b9-5f1318fa171e tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:47 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009" returned: 0 in 0.259s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:47 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:33:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-71b266c3-d5ab-494a-b3b9-5f1318fa171e tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.058s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb01eeb1-ca61-44fe-9ebc-f78981bba9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47abcb0-33a3-4b80-af93-5201e1b2e687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:47 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-71b266c3-d5ab-494a-b3b9-5f1318fa171e tempest-ProjectMemberTests-1074109481 None] Creating offline snapshot 27f0ad5b-f2ae-45ad-adc3-0abe2c942b59 of volume db7261d7-0460-43f2-8361-d568a620a0cf {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:33:47 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Volume volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009 (88cd57e1-3a7d-4729-ba2e-f74a9b383009): created successfully Nov 03 08:33:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47abcb0-33a3-4b80-af93-5201e1b2e687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:47 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Flow 'volume_create_manager' (371700b5-6504-4005-bd32-17b44e534f69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:47 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b39d02-a569-4eca-aa03-cca116045eaa]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-71b266c3-d5ab-494a-b3b9-5f1318fa171e tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:47 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-22a7a65c-3943-4739-9b6d-91c01de2ae1f tempest-SnapshotDependencyTests-251315174 None] Created volume successfully. Nov 03 08:33:47 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf Nov 03 08:33:47 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-48e96bb5-1cd3-4da2-b658-272abc20e398 tempest-SnapshotDependencyTests-251315174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:47 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-71b266c3-d5ab-494a-b3b9-5f1318fa171e tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf" returned: 0 in 0.386s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-71b266c3-d5ab-494a-b3b9-5f1318fa171e tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf.27f0ad5b-f2ae-45ad-adc3-0abe2c942b59 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:47 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf.27f0ad5b-f2ae-45ad-adc3-0abe2c942b59 1G Nov 03 08:33:47 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5009e3c5-1ef4-4d38-b5d5-99d236d60ce9 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "cinder-8afc095d-e26d-4f67-afd2-480d918a8ead-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5009e3c5-1ef4-4d38-b5d5-99d236d60ce9 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-8afc095d-e26d-4f67-afd2-480d918a8ead-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5009e3c5-1ef4-4d38-b5d5-99d236d60ce9 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "cinder-quobyte-8afc095d-e26d-4f67-afd2-480d918a8ead" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:47 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5009e3c5-1ef4-4d38-b5d5-99d236d60ce9 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-8afc095d-e26d-4f67-afd2-480d918a8ead" acquired by "delete_volume" :: waited 0.015s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:47 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[8221e3d1-3e0f-42f6-8d7e-ebdbca54d163]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:47 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5009e3c5-1ef4-4d38-b5d5-99d236d60ce9 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:47 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead Nov 03 08:33:47 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:48 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-71b266c3-d5ab-494a-b3b9-5f1318fa171e tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf.27f0ad5b-f2ae-45ad-adc3-0abe2c942b59 1G" returned: 0 in 0.423s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-71b266c3-d5ab-494a-b3b9-5f1318fa171e tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db7261d7-0460-43f2-8361-d568a620a0cf -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf.27f0ad5b-f2ae-45ad-adc3-0abe2c942b59 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:48 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db7261d7-0460-43f2-8361-d568a620a0cf -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf.27f0ad5b-f2ae-45ad-adc3-0abe2c942b59 Nov 03 08:33:48 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:48 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5009e3c5-1ef4-4d38-b5d5-99d236d60ce9 tempest-ProjectReaderTests-1056302893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead" returned: 0 in 0.381s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5009e3c5-1ef4-4d38-b5d5-99d236d60ce9 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:48 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead Nov 03 08:33:48 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:48 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-71b266c3-d5ab-494a-b3b9-5f1318fa171e tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db7261d7-0460-43f2-8361-d568a620a0cf -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf.27f0ad5b-f2ae-45ad-adc3-0abe2c942b59" returned: 0 in 0.314s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:48 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-71b266c3-d5ab-494a-b3b9-5f1318fa171e tempest-ProjectMemberTests-1074109481 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf.27f0ad5b-f2ae-45ad-adc3-0abe2c942b59 is being set with open permissions: ugo+rw Nov 03 08:33:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-71b266c3-d5ab-494a-b3b9-5f1318fa171e tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf.27f0ad5b-f2ae-45ad-adc3-0abe2c942b59 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:48 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf.27f0ad5b-f2ae-45ad-adc3-0abe2c942b59 Nov 03 08:33:48 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:48 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5009e3c5-1ef4-4d38-b5d5-99d236d60ce9 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-8afc095d-e26d-4f67-afd2-480d918a8ead" returned: 0 in 0.279s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:48 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5009e3c5-1ef4-4d38-b5d5-99d236d60ce9 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-quobyte-8afc095d-e26d-4f67-afd2-480d918a8ead" released by "delete_volume" :: held 0.719s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:48 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-5009e3c5-1ef4-4d38-b5d5-99d236d60ce9 tempest-ProjectReaderTests-1056302893 None] Created reservations ['e6b2bb6c-098f-4b6f-96ad-aac7f2cec41f', '4497bdf4-3c70-422a-92b9-f663aa6d4c5d', 'f0063676-36cb-4bed-9f40-eff38d8b411f', '9f95062c-2d93-41f8-af97-994f5bd5d420'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:33:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5009e3c5-1ef4-4d38-b5d5-99d236d60ce9 tempest-ProjectReaderTests-1056302893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5009e3c5-1ef4-4d38-b5d5-99d236d60ce9 tempest-ProjectReaderTests-1056302893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5009e3c5-1ef4-4d38-b5d5-99d236d60ce9 tempest-ProjectReaderTests-1056302893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:48 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5009e3c5-1ef4-4d38-b5d5-99d236d60ce9 tempest-ProjectReaderTests-1056302893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5009e3c5-1ef4-4d38-b5d5-99d236d60ce9 tempest-ProjectReaderTests-1056302893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5009e3c5-1ef4-4d38-b5d5-99d236d60ce9 tempest-ProjectReaderTests-1056302893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:48 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:33:48 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:48 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-71b266c3-d5ab-494a-b3b9-5f1318fa171e tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf.27f0ad5b-f2ae-45ad-adc3-0abe2c942b59" returned: 0 in 0.252s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-71b266c3-d5ab-494a-b3b9-5f1318fa171e tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:48 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf.info Nov 03 08:33:48 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:48 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5009e3c5-1ef4-4d38-b5d5-99d236d60ce9 tempest-ProjectReaderTests-1056302893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.255s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:48 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-5009e3c5-1ef4-4d38-b5d5-99d236d60ce9 tempest-ProjectReaderTests-1056302893 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:33:48 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-5009e3c5-1ef4-4d38-b5d5-99d236d60ce9 tempest-ProjectReaderTests-1056302893 None] Deleted volume successfully. Nov 03 08:33:48 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5009e3c5-1ef4-4d38-b5d5-99d236d60ce9 tempest-ProjectReaderTests-1056302893 None] Lock "cinder-8afc095d-e26d-4f67-afd2-480d918a8ead-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:48 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-71b266c3-d5ab-494a-b3b9-5f1318fa171e tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf.info" returned: 0 in 0.273s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:48 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-71b266c3-d5ab-494a-b3b9-5f1318fa171e tempest-ProjectMemberTests-1074109481 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf.info is being set with open permissions: ugo+rw Nov 03 08:33:48 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-71b266c3-d5ab-494a-b3b9-5f1318fa171e tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:48 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf.info Nov 03 08:33:48 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:49 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-71b266c3-d5ab-494a-b3b9-5f1318fa171e tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf.info" returned: 0 in 0.262s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-71b266c3-d5ab-494a-b3b9-5f1318fa171e tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.014s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-48e96bb5-1cd3-4da2-b658-272abc20e398 tempest-SnapshotDependencyTests-251315174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.609s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:49 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-48e96bb5-1cd3-4da2-b658-272abc20e398 tempest-SnapshotDependencyTests-251315174 None] Creating offline snapshot 83b3a125-1dcc-4057-9b8b-e6ec63e33653 of volume 88cd57e1-3a7d-4729-ba2e-f74a9b383009 {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:33:49 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-71b266c3-d5ab-494a-b3b9-5f1318fa171e tempest-ProjectMemberTests-1074109481 None] Create snapshot completed successfully Nov 03 08:33:49 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a0f573-0cba-4be9-ab7a-23e7fcfff9fe]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48e96bb5-1cd3-4da2-b658-272abc20e398 tempest-SnapshotDependencyTests-251315174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:49 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009 Nov 03 08:33:49 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:49 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48e96bb5-1cd3-4da2-b658-272abc20e398 tempest-SnapshotDependencyTests-251315174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009" returned: 0 in 0.391s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:49 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48e96bb5-1cd3-4da2-b658-272abc20e398 tempest-SnapshotDependencyTests-251315174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.83b3a125-1dcc-4057-9b8b-e6ec63e33653 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:49 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.83b3a125-1dcc-4057-9b8b-e6ec63e33653 1G Nov 03 08:33:49 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:50 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48e96bb5-1cd3-4da2-b658-272abc20e398 tempest-SnapshotDependencyTests-251315174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.83b3a125-1dcc-4057-9b8b-e6ec63e33653 1G" returned: 0 in 0.411s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48e96bb5-1cd3-4da2-b658-272abc20e398 tempest-SnapshotDependencyTests-251315174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.83b3a125-1dcc-4057-9b8b-e6ec63e33653 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:50 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.83b3a125-1dcc-4057-9b8b-e6ec63e33653 Nov 03 08:33:50 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:50 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-63b81687-33af-49b0-bd0e-57270fb4be6c tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-27f0ad5b-f2ae-45ad-adc3-0abe2c942b59-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:50 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-63b81687-33af-49b0-bd0e-57270fb4be6c tempest-ProjectMemberTests-1074109481 None] Lock "cinder-27f0ad5b-f2ae-45ad-adc3-0abe2c942b59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:50 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-63b81687-33af-49b0-bd0e-57270fb4be6c tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-quobyte-db7261d7-0460-43f2-8361-d568a620a0cf" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:50 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-63b81687-33af-49b0-bd0e-57270fb4be6c tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-db7261d7-0460-43f2-8361-d568a620a0cf" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:50 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-63b81687-33af-49b0-bd0e-57270fb4be6c tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-quobyte-27f0ad5b-f2ae-45ad-adc3-0abe2c942b59" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:50 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-63b81687-33af-49b0-bd0e-57270fb4be6c tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-27f0ad5b-f2ae-45ad-adc3-0abe2c942b59" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:50 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-63b81687-33af-49b0-bd0e-57270fb4be6c tempest-ProjectMemberTests-1074109481 None] Deleting offline snapshot 27f0ad5b-f2ae-45ad-adc3-0abe2c942b59 of volume db7261d7-0460-43f2-8361-d568a620a0cf {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:33:50 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-63b81687-33af-49b0-bd0e-57270fb4be6c tempest-ProjectMemberTests-1074109481 None] snapshot_file for this snap is: volume-db7261d7-0460-43f2-8361-d568a620a0cf.27f0ad5b-f2ae-45ad-adc3-0abe2c942b59 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:33:50 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8fc8bb-81fd-4ad5-9f60-d7fe0531cfca]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-63b81687-33af-49b0-bd0e-57270fb4be6c tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf.27f0ad5b-f2ae-45ad-adc3-0abe2c942b59 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:50 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48e96bb5-1cd3-4da2-b658-272abc20e398 tempest-SnapshotDependencyTests-251315174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.83b3a125-1dcc-4057-9b8b-e6ec63e33653" returned: 0 in 0.381s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:50 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-48e96bb5-1cd3-4da2-b658-272abc20e398 tempest-SnapshotDependencyTests-251315174 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.83b3a125-1dcc-4057-9b8b-e6ec63e33653 is being set with open permissions: ugo+rw Nov 03 08:33:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48e96bb5-1cd3-4da2-b658-272abc20e398 tempest-SnapshotDependencyTests-251315174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.83b3a125-1dcc-4057-9b8b-e6ec63e33653 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:50 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.83b3a125-1dcc-4057-9b8b-e6ec63e33653 Nov 03 08:33:50 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:50 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf.27f0ad5b-f2ae-45ad-adc3-0abe2c942b59 Nov 03 08:33:50 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:50 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48e96bb5-1cd3-4da2-b658-272abc20e398 tempest-SnapshotDependencyTests-251315174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.83b3a125-1dcc-4057-9b8b-e6ec63e33653" returned: 0 in 0.274s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48e96bb5-1cd3-4da2-b658-272abc20e398 tempest-SnapshotDependencyTests-251315174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:50 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.info Nov 03 08:33:50 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:50 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-63b81687-33af-49b0-bd0e-57270fb4be6c tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf.27f0ad5b-f2ae-45ad-adc3-0abe2c942b59" returned: 0 in 0.392s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:50 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-63b81687-33af-49b0-bd0e-57270fb4be6c tempest-ProjectMemberTests-1074109481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db7261d7-0460-43f2-8361-d568a620a0cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:33:50 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b968b64-afdb-4c70-86b6-dedc217d4bff]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:50 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-63b81687-33af-49b0-bd0e-57270fb4be6c tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:51 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf Nov 03 08:33:51 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:51 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48e96bb5-1cd3-4da2-b658-272abc20e398 tempest-SnapshotDependencyTests-251315174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.info" returned: 0 in 0.267s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:51 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-48e96bb5-1cd3-4da2-b658-272abc20e398 tempest-SnapshotDependencyTests-251315174 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.info is being set with open permissions: ugo+rw Nov 03 08:33:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48e96bb5-1cd3-4da2-b658-272abc20e398 tempest-SnapshotDependencyTests-251315174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:51 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.info Nov 03 08:33:51 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:51 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-63b81687-33af-49b0-bd0e-57270fb4be6c tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf" returned: 0 in 0.406s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-63b81687-33af-49b0-bd0e-57270fb4be6c tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf.27f0ad5b-f2ae-45ad-adc3-0abe2c942b59 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:51 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf.27f0ad5b-f2ae-45ad-adc3-0abe2c942b59 Nov 03 08:33:51 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:51 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-48e96bb5-1cd3-4da2-b658-272abc20e398 tempest-SnapshotDependencyTests-251315174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.info" returned: 0 in 0.289s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-48e96bb5-1cd3-4da2-b658-272abc20e398 tempest-SnapshotDependencyTests-251315174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.136s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:51 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-48e96bb5-1cd3-4da2-b658-272abc20e398 tempest-SnapshotDependencyTests-251315174 None] Create snapshot completed successfully Nov 03 08:33:51 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-63b81687-33af-49b0-bd0e-57270fb4be6c tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf.27f0ad5b-f2ae-45ad-adc3-0abe2c942b59" returned: 0 in 0.367s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-63b81687-33af-49b0-bd0e-57270fb4be6c tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf.27f0ad5b-f2ae-45ad-adc3-0abe2c942b59 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:51 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf.27f0ad5b-f2ae-45ad-adc3-0abe2c942b59 Nov 03 08:33:51 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:51 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:51 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-63b81687-33af-49b0-bd0e-57270fb4be6c tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf.27f0ad5b-f2ae-45ad-adc3-0abe2c942b59" returned: 0 in 0.257s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:51 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-63b81687-33af-49b0-bd0e-57270fb4be6c tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-27f0ad5b-f2ae-45ad-adc3-0abe2c942b59" released by "_delete_snapshot" :: held 1.543s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:51 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-63b81687-33af-49b0-bd0e-57270fb4be6c tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-db7261d7-0460-43f2-8361-d568a620a0cf" released by "delete_snapshot" :: held 1.572s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-63b81687-33af-49b0-bd0e-57270fb4be6c tempest-ProjectMemberTests-1074109481 None] Created reservations ['ed2df7e2-53c8-4433-871d-09c812767729', '4536e1f3-6b30-4b5b-8c7a-661acabd85c1', 'c40cbaaa-a702-4950-86d5-1bd248d4ef89', '86ad63d0-800f-4b66-97f6-3642a253800a'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:33:52 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-63b81687-33af-49b0-bd0e-57270fb4be6c tempest-ProjectMemberTests-1074109481 None] Delete snapshot completed successfully. Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-63b81687-33af-49b0-bd0e-57270fb4be6c tempest-ProjectMemberTests-1074109481 None] Lock "cinder-27f0ad5b-f2ae-45ad-adc3-0abe2c942b59-delete_snapshot" released by "delete_snapshot" :: held 1.731s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Flow 'volume_create_manager' (5359ce93-5f47-4999-9380-1eca2ef462fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218383df-cb77-45bd-a013-a551f15ef951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218383df-cb77-45bd-a013-a551f15ef951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc94b2d9-5e97-4803-be7a-dbbcca782219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323bb4837e244c3db0f43d01b6a57314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=83b3a125-1dcc-4057-9b8b-e6ec63e33653,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:52Z,use_quota=True,user_id='f0d71b144add48dfa0b98ec9fcd4a39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6168f493-60f7-4cc9-a491-29646ad147b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6168f493-60f7-4cc9-a491-29646ad147b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef00639-dfbc-460e-ac31-fdbfcca5891b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef00639-dfbc-460e-ac31-fdbfcca5891b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dc94b2d9-5e97-4803-be7a-dbbcca782219', 'volume_name': 'volume-dc94b2d9-5e97-4803-be7a-dbbcca782219', 'volume_size': 1, 'snapshot_id': '83b3a125-1dcc-4057-9b8b-e6ec63e33653'}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c218fc0b-6deb-4f41-a810-e77066b723e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c218fc0b-6deb-4f41-a810-e77066b723e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6694e4d0-14bf-4a5c-ad09-974129b01ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:52 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Volume dc94b2d9-5e97-4803-be7a-dbbcca782219: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dc94b2d9-5e97-4803-be7a-dbbcca782219', 'volume_size': 1, 'snapshot_id': '83b3a125-1dcc-4057-9b8b-e6ec63e33653'} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d55bd177-342c-4917-a11a-55d19aa25bc8 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-db7261d7-0460-43f2-8361-d568a620a0cf-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Acquiring lock "cinder-quobyte-83b3a125-1dcc-4057-9b8b-e6ec63e33653-dc94b2d9-5e97-4803-be7a-dbbcca782219" by "_create_volume_from_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d55bd177-342c-4917-a11a-55d19aa25bc8 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-db7261d7-0460-43f2-8361-d568a620a0cf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Lock "cinder-quobyte-83b3a125-1dcc-4057-9b8b-e6ec63e33653-dc94b2d9-5e97-4803-be7a-dbbcca782219" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Creating volume dc94b2d9-5e97-4803-be7a-dbbcca782219 from snapshot 83b3a125-1dcc-4057-9b8b-e6ec63e33653 {{(pid=86801) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Acquiring lock "cinder-quobyte-dc94b2d9-5e97-4803-be7a-dbbcca782219" by "_copy_volume_from_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Lock "cinder-quobyte-dc94b2d9-5e97-4803-be7a-dbbcca782219" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] snapshot: 83b3a125-1dcc-4057-9b8b-e6ec63e33653, volume: dc94b2d9-5e97-4803-be7a-dbbcca782219, {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d55bd177-342c-4917-a11a-55d19aa25bc8 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-quobyte-db7261d7-0460-43f2-8361-d568a620a0cf" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[f526c750-f29e-45c0-8f52-7dc506a20b7f]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.83b3a125-1dcc-4057-9b8b-e6ec63e33653 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d55bd177-342c-4917-a11a-55d19aa25bc8 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-db7261d7-0460-43f2-8361-d568a620a0cf" acquired by "delete_volume" :: waited 0.036s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a378a2-d601-4b9c-9843-5733cf996e2b]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d55bd177-342c-4917-a11a-55d19aa25bc8 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Flow 'volume_create_manager' (91c060d6-b1eb-4f9a-a696-bd4970d9d1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:52 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.83b3a125-1dcc-4057-9b8b-e6ec63e33653 Nov 03 08:33:52 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f7f3f3-5013-4f37-829b-1076794212db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f7f3f3-5013-4f37-829b-1076794212db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-667697231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf1691fd-0ab0-4c33-9bbb-97b01cfd7a69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5947b05646d40708ac71d095b98f190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:53Z,use_quota=True,user_id='a9715106a20c43959b1b2db26bd4db8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (864bfe29-55fa-468a-b6c8-920a2342318c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (864bfe29-55fa-468a-b6c8-920a2342318c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (804235d5-ad1c-4012-b8dc-7addb59059ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (804235d5-ad1c-4012-b8dc-7addb59059ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf1691fd-0ab0-4c33-9bbb-97b01cfd7a69', 'volume_name': 'volume-cf1691fd-0ab0-4c33-9bbb-97b01cfd7a69', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d702d78-60d6-4c8b-944d-793af300ce82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d702d78-60d6-4c8b-944d-793af300ce82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23e58528-f24e-41ca-8f00-98860e8df67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:52 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Volume cf1691fd-0ab0-4c33-9bbb-97b01cfd7a69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf1691fd-0ab0-4c33-9bbb-97b01cfd7a69', 'volume_size': 1} Nov 03 08:33:52 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:52 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf Nov 03 08:33:52 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:53 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.83b3a125-1dcc-4057-9b8b-e6ec63e33653" returned: 0 in 0.373s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:33:53 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda11a9d-d7fd-4ae0-963c-b85a77da01db]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:33:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:53 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d55bd177-342c-4917-a11a-55d19aa25bc8 tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf" returned: 0 in 0.396s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d55bd177-342c-4917-a11a-55d19aa25bc8 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:53 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf Nov 03 08:33:53 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:53 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009 Nov 03 08:33:53 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:53 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d55bd177-342c-4917-a11a-55d19aa25bc8 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-db7261d7-0460-43f2-8361-d568a620a0cf" returned: 0 in 0.260s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:53 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d55bd177-342c-4917-a11a-55d19aa25bc8 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-db7261d7-0460-43f2-8361-d568a620a0cf" released by "delete_volume" :: held 0.725s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:53 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009" returned: 0 in 0.386s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009 {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 08:33:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Creating direct copy from snapshot {{(pid=86801) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 08:33:53 devstack cinder-volume[86801]: DEBUG cinder.utils [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Path /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-dc94b2d9-5e97-4803-be7a-dbbcca782219 not found in is_blk_device check {{(pid=86801) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 08:33:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-dc94b2d9-5e97-4803-be7a-dbbcca782219 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:53 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-dc94b2d9-5e97-4803-be7a-dbbcca782219 Nov 03 08:33:53 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:53 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-d55bd177-342c-4917-a11a-55d19aa25bc8 tempest-ProjectMemberTests-1074109481 None] Created reservations ['791d3b75-978c-4088-9f48-83f4a915af74', '34d230cb-233c-4b82-9c3d-cdb94c0254ed', '14c6d841-8b9f-416c-b2be-7826fc0c4ba9', 'd83868d8-1e92-4252-aa2a-4764d59e8fbe'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:33:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d55bd177-342c-4917-a11a-55d19aa25bc8 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d55bd177-342c-4917-a11a-55d19aa25bc8 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d55bd177-342c-4917-a11a-55d19aa25bc8 tempest-ProjectMemberTests-1074109481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:53 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d55bd177-342c-4917-a11a-55d19aa25bc8 tempest-ProjectMemberTests-1074109481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d55bd177-342c-4917-a11a-55d19aa25bc8 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d55bd177-342c-4917-a11a-55d19aa25bc8 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:53 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:33:53 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:53 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:53 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d55bd177-342c-4917-a11a-55d19aa25bc8 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.268s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:53 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-d55bd177-342c-4917-a11a-55d19aa25bc8 tempest-ProjectMemberTests-1074109481 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:33:53 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-d55bd177-342c-4917-a11a-55d19aa25bc8 tempest-ProjectMemberTests-1074109481 None] Deleted volume successfully. Nov 03 08:33:53 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-d55bd177-342c-4917-a11a-55d19aa25bc8 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-db7261d7-0460-43f2-8361-d568a620a0cf-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:54 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:33:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Flow 'volume_create_manager' (9d2d4779-bb3c-495a-a45b-7aa465dfb51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:33:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f61557-d173-4aa8-a4d4-da6bb4948a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f61557-d173-4aa8-a4d4-da6bb4948a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-620055791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=658966ff-8446-49e0-ba0d-ad61023a5f62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0eecffb07e40e2813f1e25408d2790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:54Z,use_quota=True,user_id='c7249539ccb64caa9d422323a83818f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (724c18f1-f1e4-4bf6-8044-dec19bff6877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (724c18f1-f1e4-4bf6-8044-dec19bff6877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108f28f4-c34a-4360-8684-ba7c2f31a23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108f28f4-c34a-4360-8684-ba7c2f31a23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '658966ff-8446-49e0-ba0d-ad61023a5f62', 'volume_name': 'volume-658966ff-8446-49e0-ba0d-ad61023a5f62', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03450f15-890a-4f96-8730-80bcb236cceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03450f15-890a-4f96-8730-80bcb236cceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:33:54 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbe80a1a-8b2a-4b15-8f8d-57a4854f87da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:33:54 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Volume 658966ff-8446-49e0-ba0d-ad61023a5f62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-658966ff-8446-49e0-ba0d-ad61023a5f62', 'volume_size': 1} Nov 03 08:33:54 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:59 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-dc94b2d9-5e97-4803-be7a-dbbcca782219" returned: 0 in 6.189s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:59 devstack cinder-volume[86801]: DEBUG cinder.image.image_utils [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009, size 1024.00 MB, duration 6.19 sec, destination /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-dc94b2d9-5e97-4803-be7a-dbbcca782219 {{(pid=86801) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 08:33:59 devstack cinder-volume[86801]: INFO cinder.image.image_utils [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Converted 1024.00 MB image at 165.42 MB/s Nov 03 08:33:59 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-dc94b2d9-5e97-4803-be7a-dbbcca782219 is being set with open permissions: ugo+rw Nov 03 08:33:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-dc94b2d9-5e97-4803-be7a-dbbcca782219 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:33:59 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-dc94b2d9-5e97-4803-be7a-dbbcca782219 Nov 03 08:33:59 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:33:59 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Nov 03 08:33:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-dc94b2d9-5e97-4803-be7a-dbbcca782219" returned: 0 in 0.235s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:33:59 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Lock "cinder-quobyte-dc94b2d9-5e97-4803-be7a-dbbcca782219" released by "_copy_volume_from_snapshot" :: held 7.289s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:59 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Lock "cinder-quobyte-83b3a125-1dcc-4057-9b8b-e6ec63e33653-dc94b2d9-5e97-4803-be7a-dbbcca782219" released by "_create_volume_from_snapshot" :: held 7.365s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:33:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.399s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.082s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:59 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-667697231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf1691fd-0ab0-4c33-9bbb-97b01cfd7a69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5947b05646d40708ac71d095b98f190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:53Z,use_quota=True,user_id='a9715106a20c43959b1b2db26bd4db8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:33:59 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Creating volume cf1691fd-0ab0-4c33-9bbb-97b01cfd7a69 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:33:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:33:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:33:59 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:33:59 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:33:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:33:59 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:33:59 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:33:59 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cf1691fd-0ab0-4c33-9bbb-97b01cfd7a69 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:00 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cf1691fd-0ab0-4c33-9bbb-97b01cfd7a69 1073741824 Nov 03 08:34:00 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6694e4d0-14bf-4a5c-ad09-974129b01ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc94b2d9-5e97-4803-be7a-dbbcca782219', 'volume_size': 1, 'snapshot_id': '83b3a125-1dcc-4057-9b8b-e6ec63e33653'}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3498117b-b6c4-451d-af27-5634811183be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:00 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Volume volume-dc94b2d9-5e97-4803-be7a-dbbcca782219 (dc94b2d9-5e97-4803-be7a-dbbcca782219): created successfully Nov 03 08:34:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3498117b-b6c4-451d-af27-5634811183be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Flow 'volume_create_manager' (5359ce93-5f47-4999-9380-1eca2ef462fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:34:00 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-bab442de-a981-40bd-b2f0-f75d6a5c07b5 tempest-SnapshotDependencyTests-251315174 None] Created volume successfully. Nov 03 08:34:00 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cf1691fd-0ab0-4c33-9bbb-97b01cfd7a69 1073741824" returned: 0 in 0.425s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cf1691fd-0ab0-4c33-9bbb-97b01cfd7a69 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:00 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cf1691fd-0ab0-4c33-9bbb-97b01cfd7a69 Nov 03 08:34:00 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:00 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cf1691fd-0ab0-4c33-9bbb-97b01cfd7a69" returned: 0 in 0.238s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:34:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.261s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-620055791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=658966ff-8446-49e0-ba0d-ad61023a5f62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0eecffb07e40e2813f1e25408d2790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:33:54Z,use_quota=True,user_id='c7249539ccb64caa9d422323a83818f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:34:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Creating volume 658966ff-8446-49e0-ba0d-ad61023a5f62 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:34:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:34:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:34:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:00 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:34:00 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:34:00 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:00 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62 1073741824 Nov 03 08:34:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23e58528-f24e-41ca-8f00-98860e8df67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf1691fd-0ab0-4c33-9bbb-97b01cfd7a69', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:00 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f400486f-11cb-4554-9fb2-1b3a241d469f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:00 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Volume volume-cf1691fd-0ab0-4c33-9bbb-97b01cfd7a69 (cf1691fd-0ab0-4c33-9bbb-97b01cfd7a69): created successfully Nov 03 08:34:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f400486f-11cb-4554-9fb2-1b3a241d469f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:00 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Flow 'volume_create_manager' (91c060d6-b1eb-4f9a-a696-bd4970d9d1f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:34:00 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-1d367e9d-2093-402d-83fa-f27f3fc6ed53 tempest-ProjectReaderTests-1776073327 None] Created volume successfully. Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-250e7516-de41-4763-a8ca-053aff462d56 tempest-SnapshotDependencyTests-251315174 None] Acquiring lock "cinder-83b3a125-1dcc-4057-9b8b-e6ec63e33653-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-250e7516-de41-4763-a8ca-053aff462d56 tempest-SnapshotDependencyTests-251315174 None] Lock "cinder-83b3a125-1dcc-4057-9b8b-e6ec63e33653-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-250e7516-de41-4763-a8ca-053aff462d56 tempest-SnapshotDependencyTests-251315174 None] Acquiring lock "cinder-quobyte-88cd57e1-3a7d-4729-ba2e-f74a9b383009" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:01 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62 1073741824" returned: 0 in 0.425s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-250e7516-de41-4763-a8ca-053aff462d56 tempest-SnapshotDependencyTests-251315174 None] Lock "cinder-quobyte-88cd57e1-3a7d-4729-ba2e-f74a9b383009" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-250e7516-de41-4763-a8ca-053aff462d56 tempest-SnapshotDependencyTests-251315174 None] Acquiring lock "cinder-quobyte-83b3a125-1dcc-4057-9b8b-e6ec63e33653" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-250e7516-de41-4763-a8ca-053aff462d56 tempest-SnapshotDependencyTests-251315174 None] Lock "cinder-quobyte-83b3a125-1dcc-4057-9b8b-e6ec63e33653" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-250e7516-de41-4763-a8ca-053aff462d56 tempest-SnapshotDependencyTests-251315174 None] Deleting offline snapshot 83b3a125-1dcc-4057-9b8b-e6ec63e33653 of volume 88cd57e1-3a7d-4729-ba2e-f74a9b383009 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-250e7516-de41-4763-a8ca-053aff462d56 tempest-SnapshotDependencyTests-251315174 None] snapshot_file for this snap is: volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.83b3a125-1dcc-4057-9b8b-e6ec63e33653 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[634cfb84-4225-479d-930c-6caffa4b220e]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-250e7516-de41-4763-a8ca-053aff462d56 tempest-SnapshotDependencyTests-251315174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.83b3a125-1dcc-4057-9b8b-e6ec63e33653 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:01 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62 Nov 03 08:34:01 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:01 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.83b3a125-1dcc-4057-9b8b-e6ec63e33653 Nov 03 08:34:01 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:01 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62" returned: 0 in 0.261s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbe80a1a-8b2a-4b15-8f8d-57a4854f87da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-658966ff-8446-49e0-ba0d-ad61023a5f62', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac36732e-10fd-4c5f-9251-3540ddd79f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:01 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Volume volume-658966ff-8446-49e0-ba0d-ad61023a5f62 (658966ff-8446-49e0-ba0d-ad61023a5f62): created successfully Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac36732e-10fd-4c5f-9251-3540ddd79f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Flow 'volume_create_manager' (9d2d4779-bb3c-495a-a45b-7aa465dfb51d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ff5f21d7-0079-4dbd-a4ee-b5184285e885 tempest-ProjectReaderTests-1776073327 None] Acquiring lock "cinder-cf1691fd-0ab0-4c33-9bbb-97b01cfd7a69-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:01 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-35740d1a-6900-472b-a451-4680bfea0227 tempest-ProjectMemberTests-1074109481 None] Created volume successfully. Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ff5f21d7-0079-4dbd-a4ee-b5184285e885 tempest-ProjectReaderTests-1776073327 None] Lock "cinder-cf1691fd-0ab0-4c33-9bbb-97b01cfd7a69-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ff5f21d7-0079-4dbd-a4ee-b5184285e885 tempest-ProjectReaderTests-1776073327 None] Acquiring lock "cinder-quobyte-cf1691fd-0ab0-4c33-9bbb-97b01cfd7a69" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ff5f21d7-0079-4dbd-a4ee-b5184285e885 tempest-ProjectReaderTests-1776073327 None] Lock "cinder-quobyte-cf1691fd-0ab0-4c33-9bbb-97b01cfd7a69" acquired by "delete_volume" :: waited 0.018s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:01 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-250e7516-de41-4763-a8ca-053aff462d56 tempest-SnapshotDependencyTests-251315174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.83b3a125-1dcc-4057-9b8b-e6ec63e33653" returned: 0 in 0.421s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-250e7516-de41-4763-a8ca-053aff462d56 tempest-SnapshotDependencyTests-251315174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a1edf8-4671-48d3-a0c8-9414cffd8344]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ff5f21d7-0079-4dbd-a4ee-b5184285e885 tempest-ProjectReaderTests-1776073327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cf1691fd-0ab0-4c33-9bbb-97b01cfd7a69 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c0e01c-b19e-4062-8efe-378e0ef8b351]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:01 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-250e7516-de41-4763-a8ca-053aff462d56 tempest-SnapshotDependencyTests-251315174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:01 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cf1691fd-0ab0-4c33-9bbb-97b01cfd7a69 Nov 03 08:34:01 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:01 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009 Nov 03 08:34:01 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-af8e9c0b-d3e5-4f32-8f73-30d933480e3c tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-af8e9c0b-d3e5-4f32-8f73-30d933480e3c tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:02 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ff5f21d7-0079-4dbd-a4ee-b5184285e885 tempest-ProjectReaderTests-1776073327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cf1691fd-0ab0-4c33-9bbb-97b01cfd7a69" returned: 0 in 0.446s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ff5f21d7-0079-4dbd-a4ee-b5184285e885 tempest-ProjectReaderTests-1776073327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cf1691fd-0ab0-4c33-9bbb-97b01cfd7a69 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:02 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-af8e9c0b-d3e5-4f32-8f73-30d933480e3c tempest-ProjectMemberTests-1074109481 None] Creating offline snapshot 7b1fe999-49cd-48bb-bf1d-abfcfb3dab1b of volume 658966ff-8446-49e0-ba0d-ad61023a5f62 {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:34:02 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cf1691fd-0ab0-4c33-9bbb-97b01cfd7a69 Nov 03 08:34:02 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:02 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7935895-62ec-4073-b330-9ef0f4f95e69]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-af8e9c0b-d3e5-4f32-8f73-30d933480e3c tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:02 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-250e7516-de41-4763-a8ca-053aff462d56 tempest-SnapshotDependencyTests-251315174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009" returned: 0 in 0.589s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-250e7516-de41-4763-a8ca-053aff462d56 tempest-SnapshotDependencyTests-251315174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.83b3a125-1dcc-4057-9b8b-e6ec63e33653 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:02 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62 Nov 03 08:34:02 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:02 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.83b3a125-1dcc-4057-9b8b-e6ec63e33653 Nov 03 08:34:02 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:02 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ff5f21d7-0079-4dbd-a4ee-b5184285e885 tempest-ProjectReaderTests-1776073327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-cf1691fd-0ab0-4c33-9bbb-97b01cfd7a69" returned: 0 in 0.290s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:02 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ff5f21d7-0079-4dbd-a4ee-b5184285e885 tempest-ProjectReaderTests-1776073327 None] Lock "cinder-quobyte-cf1691fd-0ab0-4c33-9bbb-97b01cfd7a69" released by "delete_volume" :: held 0.792s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:02 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-ff5f21d7-0079-4dbd-a4ee-b5184285e885 tempest-ProjectReaderTests-1776073327 None] Created reservations ['3d6d736b-9a6d-472f-95cd-0141587dfcff', 'b1940be0-0840-4a7e-a064-4c9bc1f77a31', '71cdeb65-f64b-4fe1-a5e1-aeed142c22a6', '49ab9878-9020-416e-8b22-72b3eb00008f'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:34:02 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ff5f21d7-0079-4dbd-a4ee-b5184285e885 tempest-ProjectReaderTests-1776073327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ff5f21d7-0079-4dbd-a4ee-b5184285e885 tempest-ProjectReaderTests-1776073327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:02 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ff5f21d7-0079-4dbd-a4ee-b5184285e885 tempest-ProjectReaderTests-1776073327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:34:02 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ff5f21d7-0079-4dbd-a4ee-b5184285e885 tempest-ProjectReaderTests-1776073327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:34:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ff5f21d7-0079-4dbd-a4ee-b5184285e885 tempest-ProjectReaderTests-1776073327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ff5f21d7-0079-4dbd-a4ee-b5184285e885 tempest-ProjectReaderTests-1776073327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-af8e9c0b-d3e5-4f32-8f73-30d933480e3c tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62" returned: 0 in 0.418s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-af8e9c0b-d3e5-4f32-8f73-30d933480e3c tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62.7b1fe999-49cd-48bb-bf1d-abfcfb3dab1b 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:02 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:34:02 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:02 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62.7b1fe999-49cd-48bb-bf1d-abfcfb3dab1b 1G Nov 03 08:34:02 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:02 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-250e7516-de41-4763-a8ca-053aff462d56 tempest-SnapshotDependencyTests-251315174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.83b3a125-1dcc-4057-9b8b-e6ec63e33653" returned: 0 in 0.340s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-250e7516-de41-4763-a8ca-053aff462d56 tempest-SnapshotDependencyTests-251315174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.83b3a125-1dcc-4057-9b8b-e6ec63e33653 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:02 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.83b3a125-1dcc-4057-9b8b-e6ec63e33653 Nov 03 08:34:02 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:02 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ff5f21d7-0079-4dbd-a4ee-b5184285e885 tempest-ProjectReaderTests-1776073327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.318s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:02 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-ff5f21d7-0079-4dbd-a4ee-b5184285e885 tempest-ProjectReaderTests-1776073327 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:34:02 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-ff5f21d7-0079-4dbd-a4ee-b5184285e885 tempest-ProjectReaderTests-1776073327 None] Deleted volume successfully. Nov 03 08:34:02 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ff5f21d7-0079-4dbd-a4ee-b5184285e885 tempest-ProjectReaderTests-1776073327 None] Lock "cinder-cf1691fd-0ab0-4c33-9bbb-97b01cfd7a69-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:02 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-250e7516-de41-4763-a8ca-053aff462d56 tempest-SnapshotDependencyTests-251315174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009.83b3a125-1dcc-4057-9b8b-e6ec63e33653" returned: 0 in 0.331s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:02 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-250e7516-de41-4763-a8ca-053aff462d56 tempest-SnapshotDependencyTests-251315174 None] Lock "cinder-quobyte-83b3a125-1dcc-4057-9b8b-e6ec63e33653" released by "_delete_snapshot" :: held 1.793s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:02 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-250e7516-de41-4763-a8ca-053aff462d56 tempest-SnapshotDependencyTests-251315174 None] Lock "cinder-quobyte-88cd57e1-3a7d-4729-ba2e-f74a9b383009" released by "delete_snapshot" :: held 1.824s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:03 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-af8e9c0b-d3e5-4f32-8f73-30d933480e3c tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62.7b1fe999-49cd-48bb-bf1d-abfcfb3dab1b 1G" returned: 0 in 0.485s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-af8e9c0b-d3e5-4f32-8f73-30d933480e3c tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-658966ff-8446-49e0-ba0d-ad61023a5f62 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62.7b1fe999-49cd-48bb-bf1d-abfcfb3dab1b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:03 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-658966ff-8446-49e0-ba0d-ad61023a5f62 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62.7b1fe999-49cd-48bb-bf1d-abfcfb3dab1b Nov 03 08:34:03 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-250e7516-de41-4763-a8ca-053aff462d56 tempest-SnapshotDependencyTests-251315174 None] Created reservations ['3a578024-28b9-43be-b052-bbc46fa72a81', '0aeadf7f-6795-4881-817d-588f20c0d84b', 'f319d519-f0a2-4fa5-b315-dd583b21a048', '17600f7f-4b32-4a1d-ae4c-13ed68f597e0'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:34:03 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-250e7516-de41-4763-a8ca-053aff462d56 tempest-SnapshotDependencyTests-251315174 None] Delete snapshot completed successfully. Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-250e7516-de41-4763-a8ca-053aff462d56 tempest-SnapshotDependencyTests-251315174 None] Lock "cinder-83b3a125-1dcc-4057-9b8b-e6ec63e33653-delete_snapshot" released by "delete_snapshot" :: held 2.044s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Flow 'volume_create_manager' (6615a4b3-853f-49fa-8cc1-248c51b669de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ead4d9-a002-45e3-9de6-e41afa820e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-397265c9-492c-4700-a298-b59ecefae3f7 tempest-SnapshotDependencyTests-251315174 None] Acquiring lock "cinder-88cd57e1-3a7d-4729-ba2e-f74a9b383009-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ead4d9-a002-45e3-9de6-e41afa820e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1461531699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76159e10-1874-4dc0-a664-2b11de15fdbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5947b05646d40708ac71d095b98f190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:34:03Z,use_quota=True,user_id='a9715106a20c43959b1b2db26bd4db8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b418722-54d1-40ae-9cdb-cf942892eb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b418722-54d1-40ae-9cdb-cf942892eb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4143f87-db7d-4d91-96c3-82ffba020687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4143f87-db7d-4d91-96c3-82ffba020687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76159e10-1874-4dc0-a664-2b11de15fdbc', 'volume_name': 'volume-76159e10-1874-4dc0-a664-2b11de15fdbc', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda9fde3-89c6-42df-b985-420606209659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda9fde3-89c6-42df-b985-420606209659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:03 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00fb06dc-ed5b-4bd8-ae4d-888cf926cf63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:03 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Volume 76159e10-1874-4dc0-a664-2b11de15fdbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76159e10-1874-4dc0-a664-2b11de15fdbc', 'volume_size': 1} Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-397265c9-492c-4700-a298-b59ecefae3f7 tempest-SnapshotDependencyTests-251315174 None] Lock "cinder-88cd57e1-3a7d-4729-ba2e-f74a9b383009-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-af8e9c0b-d3e5-4f32-8f73-30d933480e3c tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-658966ff-8446-49e0-ba0d-ad61023a5f62 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62.7b1fe999-49cd-48bb-bf1d-abfcfb3dab1b" returned: 0 in 0.375s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:03 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-af8e9c0b-d3e5-4f32-8f73-30d933480e3c tempest-ProjectMemberTests-1074109481 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62.7b1fe999-49cd-48bb-bf1d-abfcfb3dab1b is being set with open permissions: ugo+rw Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-af8e9c0b-d3e5-4f32-8f73-30d933480e3c tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62.7b1fe999-49cd-48bb-bf1d-abfcfb3dab1b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:03 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62.7b1fe999-49cd-48bb-bf1d-abfcfb3dab1b Nov 03 08:34:03 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-397265c9-492c-4700-a298-b59ecefae3f7 tempest-SnapshotDependencyTests-251315174 None] Acquiring lock "cinder-quobyte-88cd57e1-3a7d-4729-ba2e-f74a9b383009" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-397265c9-492c-4700-a298-b59ecefae3f7 tempest-SnapshotDependencyTests-251315174 None] Lock "cinder-quobyte-88cd57e1-3a7d-4729-ba2e-f74a9b383009" acquired by "delete_volume" :: waited 0.019s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[120f0a9e-ff99-4425-9be6-19d9a8054a51]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-397265c9-492c-4700-a298-b59ecefae3f7 tempest-SnapshotDependencyTests-251315174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:03 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009 Nov 03 08:34:03 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:03 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-af8e9c0b-d3e5-4f32-8f73-30d933480e3c tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62.7b1fe999-49cd-48bb-bf1d-abfcfb3dab1b" returned: 0 in 0.272s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-af8e9c0b-d3e5-4f32-8f73-30d933480e3c tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:03 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62.info Nov 03 08:34:03 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:03 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:34:03 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:03 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-397265c9-492c-4700-a298-b59ecefae3f7 tempest-SnapshotDependencyTests-251315174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009" returned: 0 in 0.381s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-397265c9-492c-4700-a298-b59ecefae3f7 tempest-SnapshotDependencyTests-251315174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:03 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009 Nov 03 08:34:03 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:03 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-af8e9c0b-d3e5-4f32-8f73-30d933480e3c tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62.info" returned: 0 in 0.282s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:03 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-af8e9c0b-d3e5-4f32-8f73-30d933480e3c tempest-ProjectMemberTests-1074109481 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62.info is being set with open permissions: ugo+rw Nov 03 08:34:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-af8e9c0b-d3e5-4f32-8f73-30d933480e3c tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:04 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62.info Nov 03 08:34:04 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:04 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.276s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager._thread_info {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread count: 29 {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread info: [<_MainThread(MainThread, started 139707544170624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 08:34:04 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-397265c9-492c-4700-a298-b59ecefae3f7 tempest-SnapshotDependencyTests-251315174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-88cd57e1-3a7d-4729-ba2e-f74a9b383009" returned: 0 in 0.257s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-397265c9-492c-4700-a298-b59ecefae3f7 tempest-SnapshotDependencyTests-251315174 None] Lock "cinder-quobyte-88cd57e1-3a7d-4729-ba2e-f74a9b383009" released by "delete_volume" :: held 0.717s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-397265c9-492c-4700-a298-b59ecefae3f7 tempest-SnapshotDependencyTests-251315174 None] Created reservations ['ef02d60c-cbd6-49ea-9e1a-bb5f92a5a522', '14696fa1-b476-4d04-a942-63b9494620d0', '78a1aea3-02aa-4be5-956b-8a0db51e603e', '5856a27f-14b8-4df6-98e6-4d1d6910a9fa'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:34:04 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-af8e9c0b-d3e5-4f32-8f73-30d933480e3c tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62.info" returned: 0 in 0.262s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-af8e9c0b-d3e5-4f32-8f73-30d933480e3c tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.244s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.872s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1461531699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76159e10-1874-4dc0-a664-2b11de15fdbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5947b05646d40708ac71d095b98f190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:34:03Z,use_quota=True,user_id='a9715106a20c43959b1b2db26bd4db8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Creating volume 76159e10-1874-4dc0-a664-2b11de15fdbc {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:34:04 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-76159e10-1874-4dc0-a664-2b11de15fdbc 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:04 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-76159e10-1874-4dc0-a664-2b11de15fdbc 1073741824 Nov 03 08:34:04 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:04 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-af8e9c0b-d3e5-4f32-8f73-30d933480e3c tempest-ProjectMemberTests-1074109481 None] Create snapshot completed successfully Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-397265c9-492c-4700-a298-b59ecefae3f7 tempest-SnapshotDependencyTests-251315174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-397265c9-492c-4700-a298-b59ecefae3f7 tempest-SnapshotDependencyTests-251315174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-397265c9-492c-4700-a298-b59ecefae3f7 tempest-SnapshotDependencyTests-251315174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-397265c9-492c-4700-a298-b59ecefae3f7 tempest-SnapshotDependencyTests-251315174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-397265c9-492c-4700-a298-b59ecefae3f7 tempest-SnapshotDependencyTests-251315174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-397265c9-492c-4700-a298-b59ecefae3f7 tempest-SnapshotDependencyTests-251315174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:04 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:34:04 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ebfbcad1-add0-4417-96c1-e04112aa26c9 tempest-SnapshotDependencyTests-251315174 None] Acquiring lock "cinder-dc94b2d9-5e97-4803-be7a-dbbcca782219-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ebfbcad1-add0-4417-96c1-e04112aa26c9 tempest-SnapshotDependencyTests-251315174 None] Lock "cinder-dc94b2d9-5e97-4803-be7a-dbbcca782219-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ebfbcad1-add0-4417-96c1-e04112aa26c9 tempest-SnapshotDependencyTests-251315174 None] Acquiring lock "cinder-quobyte-dc94b2d9-5e97-4803-be7a-dbbcca782219" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ebfbcad1-add0-4417-96c1-e04112aa26c9 tempest-SnapshotDependencyTests-251315174 None] Lock "cinder-quobyte-dc94b2d9-5e97-4803-be7a-dbbcca782219" acquired by "delete_volume" :: waited 0.017s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f21133d-c442-4bc1-8771-0c46f75e11ff]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ebfbcad1-add0-4417-96c1-e04112aa26c9 tempest-SnapshotDependencyTests-251315174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-dc94b2d9-5e97-4803-be7a-dbbcca782219 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:04 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-397265c9-492c-4700-a298-b59ecefae3f7 tempest-SnapshotDependencyTests-251315174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.284s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-397265c9-492c-4700-a298-b59ecefae3f7 tempest-SnapshotDependencyTests-251315174 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:34:04 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-397265c9-492c-4700-a298-b59ecefae3f7 tempest-SnapshotDependencyTests-251315174 None] Deleted volume successfully. Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-397265c9-492c-4700-a298-b59ecefae3f7 tempest-SnapshotDependencyTests-251315174 None] Lock "cinder-88cd57e1-3a7d-4729-ba2e-f74a9b383009-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:04 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-dc94b2d9-5e97-4803-be7a-dbbcca782219 Nov 03 08:34:04 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:04 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-76159e10-1874-4dc0-a664-2b11de15fdbc 1073741824" returned: 0 in 0.483s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-76159e10-1874-4dc0-a664-2b11de15fdbc {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:04 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-76159e10-1874-4dc0-a664-2b11de15fdbc Nov 03 08:34:04 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:04 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ebfbcad1-add0-4417-96c1-e04112aa26c9 tempest-SnapshotDependencyTests-251315174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-dc94b2d9-5e97-4803-be7a-dbbcca782219" returned: 0 in 0.379s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:04 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ebfbcad1-add0-4417-96c1-e04112aa26c9 tempest-SnapshotDependencyTests-251315174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-dc94b2d9-5e97-4803-be7a-dbbcca782219 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:05 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-dc94b2d9-5e97-4803-be7a-dbbcca782219 Nov 03 08:34:05 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:05 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-76159e10-1874-4dc0-a664-2b11de15fdbc" returned: 0 in 0.261s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00fb06dc-ed5b-4bd8-ae4d-888cf926cf63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76159e10-1874-4dc0-a664-2b11de15fdbc', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f7b0884-9ba5-4c1b-9c51-73cbb4250304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:05 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Volume volume-76159e10-1874-4dc0-a664-2b11de15fdbc (76159e10-1874-4dc0-a664-2b11de15fdbc): created successfully Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f7b0884-9ba5-4c1b-9c51-73cbb4250304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Flow 'volume_create_manager' (6615a4b3-853f-49fa-8cc1-248c51b669de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:34:05 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-eb45c4e4-e2a6-4b98-b77b-8fd725cb6eeb tempest-ProjectReaderTests-1776073327 None] Created volume successfully. Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c1333a99-fc81-4433-9a9f-4ccdfd948fcf tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-7b1fe999-49cd-48bb-bf1d-abfcfb3dab1b-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c1333a99-fc81-4433-9a9f-4ccdfd948fcf tempest-ProjectMemberTests-1074109481 None] Lock "cinder-7b1fe999-49cd-48bb-bf1d-abfcfb3dab1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c1333a99-fc81-4433-9a9f-4ccdfd948fcf tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-quobyte-658966ff-8446-49e0-ba0d-ad61023a5f62" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c1333a99-fc81-4433-9a9f-4ccdfd948fcf tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-658966ff-8446-49e0-ba0d-ad61023a5f62" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c1333a99-fc81-4433-9a9f-4ccdfd948fcf tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-quobyte-7b1fe999-49cd-48bb-bf1d-abfcfb3dab1b" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c1333a99-fc81-4433-9a9f-4ccdfd948fcf tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-7b1fe999-49cd-48bb-bf1d-abfcfb3dab1b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-c1333a99-fc81-4433-9a9f-4ccdfd948fcf tempest-ProjectMemberTests-1074109481 None] Deleting offline snapshot 7b1fe999-49cd-48bb-bf1d-abfcfb3dab1b of volume 658966ff-8446-49e0-ba0d-ad61023a5f62 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-c1333a99-fc81-4433-9a9f-4ccdfd948fcf tempest-ProjectMemberTests-1074109481 None] snapshot_file for this snap is: volume-658966ff-8446-49e0-ba0d-ad61023a5f62.7b1fe999-49cd-48bb-bf1d-abfcfb3dab1b {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:34:05 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c5c233-74e8-45b5-a988-5a164deb3624]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c1333a99-fc81-4433-9a9f-4ccdfd948fcf tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62.7b1fe999-49cd-48bb-bf1d-abfcfb3dab1b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ebfbcad1-add0-4417-96c1-e04112aa26c9 tempest-SnapshotDependencyTests-251315174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-dc94b2d9-5e97-4803-be7a-dbbcca782219" returned: 0 in 0.316s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ebfbcad1-add0-4417-96c1-e04112aa26c9 tempest-SnapshotDependencyTests-251315174 None] Lock "cinder-quobyte-dc94b2d9-5e97-4803-be7a-dbbcca782219" released by "delete_volume" :: held 0.746s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-ebfbcad1-add0-4417-96c1-e04112aa26c9 tempest-SnapshotDependencyTests-251315174 None] Created reservations ['87a295e7-3c29-4ca5-98c3-c9ab6873f68e', 'ddead85b-35ac-490e-b5b2-0096ade12de7', '6c2360cc-68f7-46a8-bab3-75c919d0f290', 'b4ec9ba3-9b19-493f-9e4f-b1e703bbe1a2'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a39fda6b-2ee5-488c-88b6-d3ecf9017051 tempest-ProjectReaderTests-1776073327 None] Acquiring lock "cinder-76159e10-1874-4dc0-a664-2b11de15fdbc-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:05 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62.7b1fe999-49cd-48bb-bf1d-abfcfb3dab1b Nov 03 08:34:05 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a39fda6b-2ee5-488c-88b6-d3ecf9017051 tempest-ProjectReaderTests-1776073327 None] Lock "cinder-76159e10-1874-4dc0-a664-2b11de15fdbc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ebfbcad1-add0-4417-96c1-e04112aa26c9 tempest-SnapshotDependencyTests-251315174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ebfbcad1-add0-4417-96c1-e04112aa26c9 tempest-SnapshotDependencyTests-251315174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ebfbcad1-add0-4417-96c1-e04112aa26c9 tempest-SnapshotDependencyTests-251315174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-ebfbcad1-add0-4417-96c1-e04112aa26c9 tempest-SnapshotDependencyTests-251315174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-ebfbcad1-add0-4417-96c1-e04112aa26c9 tempest-SnapshotDependencyTests-251315174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ebfbcad1-add0-4417-96c1-e04112aa26c9 tempest-SnapshotDependencyTests-251315174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a39fda6b-2ee5-488c-88b6-d3ecf9017051 tempest-ProjectReaderTests-1776073327 None] Acquiring lock "cinder-quobyte-76159e10-1874-4dc0-a664-2b11de15fdbc" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:05 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:34:05 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a39fda6b-2ee5-488c-88b6-d3ecf9017051 tempest-ProjectReaderTests-1776073327 None] Lock "cinder-quobyte-76159e10-1874-4dc0-a664-2b11de15fdbc" acquired by "delete_volume" :: waited 0.024s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[8659002c-3219-40b6-989d-4fbcd31b5f8a]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a39fda6b-2ee5-488c-88b6-d3ecf9017051 tempest-ProjectReaderTests-1776073327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-76159e10-1874-4dc0-a664-2b11de15fdbc {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:05 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-76159e10-1874-4dc0-a664-2b11de15fdbc Nov 03 08:34:05 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:05 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c1333a99-fc81-4433-9a9f-4ccdfd948fcf tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62.7b1fe999-49cd-48bb-bf1d-abfcfb3dab1b" returned: 0 in 0.458s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-c1333a99-fc81-4433-9a9f-4ccdfd948fcf tempest-ProjectMemberTests-1074109481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-658966ff-8446-49e0-ba0d-ad61023a5f62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:34:05 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-ebfbcad1-add0-4417-96c1-e04112aa26c9 tempest-SnapshotDependencyTests-251315174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.305s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-ebfbcad1-add0-4417-96c1-e04112aa26c9 tempest-SnapshotDependencyTests-251315174 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:34:05 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-ebfbcad1-add0-4417-96c1-e04112aa26c9 tempest-SnapshotDependencyTests-251315174 None] Deleted volume successfully. Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a4eccb-5081-4454-ac3e-e952bd58da39]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c1333a99-fc81-4433-9a9f-4ccdfd948fcf tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-ebfbcad1-add0-4417-96c1-e04112aa26c9 tempest-SnapshotDependencyTests-251315174 None] Lock "cinder-dc94b2d9-5e97-4803-be7a-dbbcca782219-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:05 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62 Nov 03 08:34:05 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:05 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a39fda6b-2ee5-488c-88b6-d3ecf9017051 tempest-ProjectReaderTests-1776073327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-76159e10-1874-4dc0-a664-2b11de15fdbc" returned: 0 in 0.429s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:05 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a39fda6b-2ee5-488c-88b6-d3ecf9017051 tempest-ProjectReaderTests-1776073327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-76159e10-1874-4dc0-a664-2b11de15fdbc {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:06 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-76159e10-1874-4dc0-a664-2b11de15fdbc Nov 03 08:34:06 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:06 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c1333a99-fc81-4433-9a9f-4ccdfd948fcf tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62" returned: 0 in 0.389s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c1333a99-fc81-4433-9a9f-4ccdfd948fcf tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62.7b1fe999-49cd-48bb-bf1d-abfcfb3dab1b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:06 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62.7b1fe999-49cd-48bb-bf1d-abfcfb3dab1b Nov 03 08:34:06 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:06 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a39fda6b-2ee5-488c-88b6-d3ecf9017051 tempest-ProjectReaderTests-1776073327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-76159e10-1874-4dc0-a664-2b11de15fdbc" returned: 0 in 0.296s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:06 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a39fda6b-2ee5-488c-88b6-d3ecf9017051 tempest-ProjectReaderTests-1776073327 None] Lock "cinder-quobyte-76159e10-1874-4dc0-a664-2b11de15fdbc" released by "delete_volume" :: held 0.769s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:06 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-a39fda6b-2ee5-488c-88b6-d3ecf9017051 tempest-ProjectReaderTests-1776073327 None] Created reservations ['016abb5e-c972-4eac-8afd-9aea6479d90b', '3da93517-e671-4b63-a98b-7a970861629c', 'ae0f8f09-06dd-4b6b-ac8b-dcf2fe75a0f7', '135434ce-dbde-48e6-80ea-e9c9e84967d6'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:34:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a39fda6b-2ee5-488c-88b6-d3ecf9017051 tempest-ProjectReaderTests-1776073327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a39fda6b-2ee5-488c-88b6-d3ecf9017051 tempest-ProjectReaderTests-1776073327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a39fda6b-2ee5-488c-88b6-d3ecf9017051 tempest-ProjectReaderTests-1776073327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:34:06 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a39fda6b-2ee5-488c-88b6-d3ecf9017051 tempest-ProjectReaderTests-1776073327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:34:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a39fda6b-2ee5-488c-88b6-d3ecf9017051 tempest-ProjectReaderTests-1776073327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a39fda6b-2ee5-488c-88b6-d3ecf9017051 tempest-ProjectReaderTests-1776073327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:06 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:34:06 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:06 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c1333a99-fc81-4433-9a9f-4ccdfd948fcf tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62.7b1fe999-49cd-48bb-bf1d-abfcfb3dab1b" returned: 0 in 0.449s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c1333a99-fc81-4433-9a9f-4ccdfd948fcf tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62.7b1fe999-49cd-48bb-bf1d-abfcfb3dab1b {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:06 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62.7b1fe999-49cd-48bb-bf1d-abfcfb3dab1b Nov 03 08:34:06 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:06 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a39fda6b-2ee5-488c-88b6-d3ecf9017051 tempest-ProjectReaderTests-1776073327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.298s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:06 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-a39fda6b-2ee5-488c-88b6-d3ecf9017051 tempest-ProjectReaderTests-1776073327 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:34:06 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-a39fda6b-2ee5-488c-88b6-d3ecf9017051 tempest-ProjectReaderTests-1776073327 None] Deleted volume successfully. Nov 03 08:34:06 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-a39fda6b-2ee5-488c-88b6-d3ecf9017051 tempest-ProjectReaderTests-1776073327 None] Lock "cinder-76159e10-1874-4dc0-a664-2b11de15fdbc-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:06 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:06 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c1333a99-fc81-4433-9a9f-4ccdfd948fcf tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62.7b1fe999-49cd-48bb-bf1d-abfcfb3dab1b" returned: 0 in 0.307s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:07 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c1333a99-fc81-4433-9a9f-4ccdfd948fcf tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-7b1fe999-49cd-48bb-bf1d-abfcfb3dab1b" released by "_delete_snapshot" :: held 1.748s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:07 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c1333a99-fc81-4433-9a9f-4ccdfd948fcf tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-658966ff-8446-49e0-ba0d-ad61023a5f62" released by "delete_snapshot" :: held 1.776s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:07 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-c1333a99-fc81-4433-9a9f-4ccdfd948fcf tempest-ProjectMemberTests-1074109481 None] Created reservations ['b25d4f6d-2bad-40fb-88da-b51cb0fd83c8', '1e8899d6-da54-4c10-929e-83233beb50cc', '502d5b14-c0f7-4770-915b-162edd975d51', 'a66aac63-cbee-413a-98f8-83ab3ae8aa0b'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:34:07 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-c1333a99-fc81-4433-9a9f-4ccdfd948fcf tempest-ProjectMemberTests-1074109481 None] Delete snapshot completed successfully. Nov 03 08:34:07 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c1333a99-fc81-4433-9a9f-4ccdfd948fcf tempest-ProjectMemberTests-1074109481 None] Lock "cinder-7b1fe999-49cd-48bb-bf1d-abfcfb3dab1b-delete_snapshot" released by "delete_snapshot" :: held 1.924s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:07 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c906f953-da75-4cca-9e87-3c8542eeef3e tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-658966ff-8446-49e0-ba0d-ad61023a5f62-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:07 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c906f953-da75-4cca-9e87-3c8542eeef3e tempest-ProjectMemberTests-1074109481 None] Lock "cinder-658966ff-8446-49e0-ba0d-ad61023a5f62-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:07 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c906f953-da75-4cca-9e87-3c8542eeef3e tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-quobyte-658966ff-8446-49e0-ba0d-ad61023a5f62" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:07 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c906f953-da75-4cca-9e87-3c8542eeef3e tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-658966ff-8446-49e0-ba0d-ad61023a5f62" acquired by "delete_volume" :: waited 0.018s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:07 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63ac6ff-689c-4597-9093-f72724232eaa]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c906f953-da75-4cca-9e87-3c8542eeef3e tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:07 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62 Nov 03 08:34:07 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:07 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c906f953-da75-4cca-9e87-3c8542eeef3e tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62" returned: 0 in 0.401s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:07 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c906f953-da75-4cca-9e87-3c8542eeef3e tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:07 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62 Nov 03 08:34:07 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:08 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c906f953-da75-4cca-9e87-3c8542eeef3e tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-658966ff-8446-49e0-ba0d-ad61023a5f62" returned: 0 in 0.270s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:08 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c906f953-da75-4cca-9e87-3c8542eeef3e tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-658966ff-8446-49e0-ba0d-ad61023a5f62" released by "delete_volume" :: held 0.751s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:08 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=184,cinder:INSERT=68,cinder:UPDATE=253,cinder:DELETE=25 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:34:08 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=201,cinder:INSERT=70,cinder:UPDATE=243,cinder:DELETE=17 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:34:08 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-c906f953-da75-4cca-9e87-3c8542eeef3e tempest-ProjectMemberTests-1074109481 None] Created reservations ['7b5c5fce-0243-4345-a56a-ed7ca910ecd3', '4ad21505-cbd4-4a74-a7d2-bad9333efcf2', 'defc2ad5-378a-48e0-b65b-5f6590410500', '3860f6be-4637-4936-827b-274f79f7acbe'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:34:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c906f953-da75-4cca-9e87-3c8542eeef3e tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c906f953-da75-4cca-9e87-3c8542eeef3e tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:08 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c906f953-da75-4cca-9e87-3c8542eeef3e tempest-ProjectMemberTests-1074109481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:34:08 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c906f953-da75-4cca-9e87-3c8542eeef3e tempest-ProjectMemberTests-1074109481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:34:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c906f953-da75-4cca-9e87-3c8542eeef3e tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c906f953-da75-4cca-9e87-3c8542eeef3e tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:08 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:34:08 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:08 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:08 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c906f953-da75-4cca-9e87-3c8542eeef3e tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.276s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:08 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-c906f953-da75-4cca-9e87-3c8542eeef3e tempest-ProjectMemberTests-1074109481 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:34:08 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-c906f953-da75-4cca-9e87-3c8542eeef3e tempest-ProjectMemberTests-1074109481 None] Deleted volume successfully. Nov 03 08:34:08 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c906f953-da75-4cca-9e87-3c8542eeef3e tempest-ProjectMemberTests-1074109481 None] Lock "cinder-658966ff-8446-49e0-ba0d-ad61023a5f62-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Flow 'volume_create_manager' (32c7146c-85a7-4ccf-9993-f460fa22a311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eaa96da-eb6a-4500-8232-331f0b147a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eaa96da-eb6a-4500-8232-331f0b147a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1713894431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23533db6-4b43-4b43-84f9-558e50f15126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0eecffb07e40e2813f1e25408d2790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:34:09Z,use_quota=True,user_id='c7249539ccb64caa9d422323a83818f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dd51fa8-5efd-4fc0-838a-c3fe98d636a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dd51fa8-5efd-4fc0-838a-c3fe98d636a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d262e5-c3e4-4c95-beda-07da775c09de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d262e5-c3e4-4c95-beda-07da775c09de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23533db6-4b43-4b43-84f9-558e50f15126', 'volume_name': 'volume-23533db6-4b43-4b43-84f9-558e50f15126', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a91606f7-a072-4ead-bd46-92adc102045b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a91606f7-a072-4ead-bd46-92adc102045b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a99c7b-695b-4639-9ecd-3b8705966684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:09 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Volume 23533db6-4b43-4b43-84f9-558e50f15126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23533db6-4b43-4b43-84f9-558e50f15126', 'volume_size': 1} Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1713894431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23533db6-4b43-4b43-84f9-558e50f15126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0eecffb07e40e2813f1e25408d2790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:34:09Z,use_quota=True,user_id='c7249539ccb64caa9d422323a83818f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Creating volume 23533db6-4b43-4b43-84f9-558e50f15126 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:34:09 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:09 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126 1073741824 Nov 03 08:34:09 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:09 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126 1073741824" returned: 0 in 0.508s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:09 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126 Nov 03 08:34:09 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:09 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126" returned: 0 in 0.255s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a99c7b-695b-4639-9ecd-3b8705966684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23533db6-4b43-4b43-84f9-558e50f15126', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dac163b-61af-47ee-b88c-7badaf574310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:09 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Volume volume-23533db6-4b43-4b43-84f9-558e50f15126 (23533db6-4b43-4b43-84f9-558e50f15126): created successfully Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dac163b-61af-47ee-b88c-7badaf574310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:09 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Flow 'volume_create_manager' (32c7146c-85a7-4ccf-9993-f460fa22a311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:34:09 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-68280239-dd08-48fb-ab69-8e32881a2fd1 tempest-ProjectMemberTests-1074109481 None] Created volume successfully. Nov 03 08:34:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3f84008d-bbad-414b-bbcf-89d86453ee57 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3f84008d-bbad-414b-bbcf-89d86453ee57 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:11 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-3f84008d-bbad-414b-bbcf-89d86453ee57 tempest-ProjectMemberTests-1074109481 None] Creating offline snapshot 4165ccbe-9022-4ee5-b036-4a427e8b116f of volume 23533db6-4b43-4b43-84f9-558e50f15126 {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:34:11 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f6063c-a30a-48e5-9974-aa40ec8d2c19]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3f84008d-bbad-414b-bbcf-89d86453ee57 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:11 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126 Nov 03 08:34:11 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:11 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3f84008d-bbad-414b-bbcf-89d86453ee57 tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126" returned: 0 in 0.407s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:11 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3f84008d-bbad-414b-bbcf-89d86453ee57 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126.4165ccbe-9022-4ee5-b036-4a427e8b116f 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:11 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126.4165ccbe-9022-4ee5-b036-4a427e8b116f 1G Nov 03 08:34:11 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:12 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3f84008d-bbad-414b-bbcf-89d86453ee57 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126.4165ccbe-9022-4ee5-b036-4a427e8b116f 1G" returned: 0 in 0.407s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3f84008d-bbad-414b-bbcf-89d86453ee57 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23533db6-4b43-4b43-84f9-558e50f15126 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126.4165ccbe-9022-4ee5-b036-4a427e8b116f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:12 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23533db6-4b43-4b43-84f9-558e50f15126 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126.4165ccbe-9022-4ee5-b036-4a427e8b116f Nov 03 08:34:12 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:12 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3f84008d-bbad-414b-bbcf-89d86453ee57 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23533db6-4b43-4b43-84f9-558e50f15126 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126.4165ccbe-9022-4ee5-b036-4a427e8b116f" returned: 0 in 0.302s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:12 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-3f84008d-bbad-414b-bbcf-89d86453ee57 tempest-ProjectMemberTests-1074109481 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126.4165ccbe-9022-4ee5-b036-4a427e8b116f is being set with open permissions: ugo+rw Nov 03 08:34:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3f84008d-bbad-414b-bbcf-89d86453ee57 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126.4165ccbe-9022-4ee5-b036-4a427e8b116f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:12 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126.4165ccbe-9022-4ee5-b036-4a427e8b116f Nov 03 08:34:12 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:12 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3f84008d-bbad-414b-bbcf-89d86453ee57 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126.4165ccbe-9022-4ee5-b036-4a427e8b116f" returned: 0 in 0.272s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:12 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3f84008d-bbad-414b-bbcf-89d86453ee57 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:12 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126.info Nov 03 08:34:12 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:13 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3f84008d-bbad-414b-bbcf-89d86453ee57 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126.info" returned: 0 in 0.244s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:13 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-3f84008d-bbad-414b-bbcf-89d86453ee57 tempest-ProjectMemberTests-1074109481 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126.info is being set with open permissions: ugo+rw Nov 03 08:34:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3f84008d-bbad-414b-bbcf-89d86453ee57 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:13 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126.info Nov 03 08:34:13 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:13 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3f84008d-bbad-414b-bbcf-89d86453ee57 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126.info" returned: 0 in 0.238s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3f84008d-bbad-414b-bbcf-89d86453ee57 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.952s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:13 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-3f84008d-bbad-414b-bbcf-89d86453ee57 tempest-ProjectMemberTests-1074109481 None] Create snapshot completed successfully Nov 03 08:34:13 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1daa355f-7bb3-4ef3-b993-ba17f68d0aa6 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-4165ccbe-9022-4ee5-b036-4a427e8b116f-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:13 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1daa355f-7bb3-4ef3-b993-ba17f68d0aa6 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-4165ccbe-9022-4ee5-b036-4a427e8b116f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:13 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1daa355f-7bb3-4ef3-b993-ba17f68d0aa6 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-quobyte-23533db6-4b43-4b43-84f9-558e50f15126" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:13 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1daa355f-7bb3-4ef3-b993-ba17f68d0aa6 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-23533db6-4b43-4b43-84f9-558e50f15126" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:13 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1daa355f-7bb3-4ef3-b993-ba17f68d0aa6 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-quobyte-4165ccbe-9022-4ee5-b036-4a427e8b116f" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:13 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1daa355f-7bb3-4ef3-b993-ba17f68d0aa6 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-4165ccbe-9022-4ee5-b036-4a427e8b116f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:13 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-1daa355f-7bb3-4ef3-b993-ba17f68d0aa6 tempest-ProjectMemberTests-1074109481 None] Deleting offline snapshot 4165ccbe-9022-4ee5-b036-4a427e8b116f of volume 23533db6-4b43-4b43-84f9-558e50f15126 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:34:13 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-1daa355f-7bb3-4ef3-b993-ba17f68d0aa6 tempest-ProjectMemberTests-1074109481 None] snapshot_file for this snap is: volume-23533db6-4b43-4b43-84f9-558e50f15126.4165ccbe-9022-4ee5-b036-4a427e8b116f {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:34:13 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef108049-e3f7-400d-be36-baf00fb3e828]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:13 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1daa355f-7bb3-4ef3-b993-ba17f68d0aa6 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126.4165ccbe-9022-4ee5-b036-4a427e8b116f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:13 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126.4165ccbe-9022-4ee5-b036-4a427e8b116f Nov 03 08:34:13 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:14 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1daa355f-7bb3-4ef3-b993-ba17f68d0aa6 tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126.4165ccbe-9022-4ee5-b036-4a427e8b116f" returned: 0 in 0.397s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:14 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-1daa355f-7bb3-4ef3-b993-ba17f68d0aa6 tempest-ProjectMemberTests-1074109481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23533db6-4b43-4b43-84f9-558e50f15126(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:34:14 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c326408-e834-4840-b32e-fe2c63fbeabb]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1daa355f-7bb3-4ef3-b993-ba17f68d0aa6 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:14 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126 Nov 03 08:34:14 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:14 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1daa355f-7bb3-4ef3-b993-ba17f68d0aa6 tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126" returned: 0 in 0.405s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1daa355f-7bb3-4ef3-b993-ba17f68d0aa6 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126.4165ccbe-9022-4ee5-b036-4a427e8b116f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:14 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126.4165ccbe-9022-4ee5-b036-4a427e8b116f Nov 03 08:34:14 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:14 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1daa355f-7bb3-4ef3-b993-ba17f68d0aa6 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126.4165ccbe-9022-4ee5-b036-4a427e8b116f" returned: 0 in 0.372s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:14 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1daa355f-7bb3-4ef3-b993-ba17f68d0aa6 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126.4165ccbe-9022-4ee5-b036-4a427e8b116f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:14 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126.4165ccbe-9022-4ee5-b036-4a427e8b116f Nov 03 08:34:14 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:15 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-1daa355f-7bb3-4ef3-b993-ba17f68d0aa6 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126.4165ccbe-9022-4ee5-b036-4a427e8b116f" returned: 0 in 0.263s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:15 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1daa355f-7bb3-4ef3-b993-ba17f68d0aa6 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-4165ccbe-9022-4ee5-b036-4a427e8b116f" released by "_delete_snapshot" :: held 1.583s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:15 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1daa355f-7bb3-4ef3-b993-ba17f68d0aa6 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-23533db6-4b43-4b43-84f9-558e50f15126" released by "delete_snapshot" :: held 1.608s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:15 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-1daa355f-7bb3-4ef3-b993-ba17f68d0aa6 tempest-ProjectMemberTests-1074109481 None] Created reservations ['74983e6e-2a28-4c42-9f52-a40a35446b46', '273991a6-17de-47b8-8443-53696231d9f9', '0a9f9da1-1302-4f28-826e-376c3095d979', 'fad0bf6a-29b3-4641-b6ef-c2d04f03d5f6'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:34:15 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-1daa355f-7bb3-4ef3-b993-ba17f68d0aa6 tempest-ProjectMemberTests-1074109481 None] Delete snapshot completed successfully. Nov 03 08:34:15 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-1daa355f-7bb3-4ef3-b993-ba17f68d0aa6 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-4165ccbe-9022-4ee5-b036-4a427e8b116f-delete_snapshot" released by "delete_snapshot" :: held 1.794s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:15 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b3fc5256-d6b7-4fb9-a59c-1baf81009576 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-23533db6-4b43-4b43-84f9-558e50f15126-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:15 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b3fc5256-d6b7-4fb9-a59c-1baf81009576 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-23533db6-4b43-4b43-84f9-558e50f15126-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:15 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b3fc5256-d6b7-4fb9-a59c-1baf81009576 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-quobyte-23533db6-4b43-4b43-84f9-558e50f15126" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:15 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b3fc5256-d6b7-4fb9-a59c-1baf81009576 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-23533db6-4b43-4b43-84f9-558e50f15126" acquired by "delete_volume" :: waited 0.017s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:15 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c0e009-7db1-490d-bb95-eafd881a6faf]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:15 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b3fc5256-d6b7-4fb9-a59c-1baf81009576 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:15 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126 Nov 03 08:34:15 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:16 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b3fc5256-d6b7-4fb9-a59c-1baf81009576 tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126" returned: 0 in 0.364s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b3fc5256-d6b7-4fb9-a59c-1baf81009576 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:16 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126 Nov 03 08:34:16 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:16 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b3fc5256-d6b7-4fb9-a59c-1baf81009576 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-23533db6-4b43-4b43-84f9-558e50f15126" returned: 0 in 0.247s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:16 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b3fc5256-d6b7-4fb9-a59c-1baf81009576 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-23533db6-4b43-4b43-84f9-558e50f15126" released by "delete_volume" :: held 0.683s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:16 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-b3fc5256-d6b7-4fb9-a59c-1baf81009576 tempest-ProjectMemberTests-1074109481 None] Created reservations ['48be75e7-f9cd-43e7-b9f4-6f12ab53e614', '5c0d3c54-4bfc-4f06-9452-572db6295dde', 'af0855b7-76af-439a-8153-03ed94cf38d6', '765a7717-037e-4588-99a3-7e4a04b84b84'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:34:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b3fc5256-d6b7-4fb9-a59c-1baf81009576 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b3fc5256-d6b7-4fb9-a59c-1baf81009576 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b3fc5256-d6b7-4fb9-a59c-1baf81009576 tempest-ProjectMemberTests-1074109481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:34:16 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-b3fc5256-d6b7-4fb9-a59c-1baf81009576 tempest-ProjectMemberTests-1074109481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:34:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b3fc5256-d6b7-4fb9-a59c-1baf81009576 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b3fc5256-d6b7-4fb9-a59c-1baf81009576 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:16 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:34:16 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:16 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:16 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b3fc5256-d6b7-4fb9-a59c-1baf81009576 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.255s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:16 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-b3fc5256-d6b7-4fb9-a59c-1baf81009576 tempest-ProjectMemberTests-1074109481 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:34:16 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-b3fc5256-d6b7-4fb9-a59c-1baf81009576 tempest-ProjectMemberTests-1074109481 None] Deleted volume successfully. Nov 03 08:34:16 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-b3fc5256-d6b7-4fb9-a59c-1baf81009576 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-23533db6-4b43-4b43-84f9-558e50f15126-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:17 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:34:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Flow 'volume_create_manager' (e7a4c086-402f-4865-8c8b-d8a9c991ecd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:34:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcb29db8-0d4d-466d-a6f1-a2cda6a55a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcb29db8-0d4d-466d-a6f1-a2cda6a55a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-883438107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b146df82-1512-417e-bd2d-4730ab03759d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0eecffb07e40e2813f1e25408d2790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:34:17Z,use_quota=True,user_id='c7249539ccb64caa9d422323a83818f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70f58d96-5736-4888-8d9c-6eeccfbd9257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70f58d96-5736-4888-8d9c-6eeccfbd9257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cf3fe52-4bfe-4361-a221-df3b707f2049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cf3fe52-4bfe-4361-a221-df3b707f2049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b146df82-1512-417e-bd2d-4730ab03759d', 'volume_name': 'volume-b146df82-1512-417e-bd2d-4730ab03759d', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dcac710-59ee-4c23-96c8-b940ecd0b5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dcac710-59ee-4c23-96c8-b940ecd0b5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:17 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9404ed-614e-48ac-a7c5-aaef36d150da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:17 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Volume b146df82-1512-417e-bd2d-4730ab03759d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b146df82-1512-417e-bd2d-4730ab03759d', 'volume_size': 1} Nov 03 08:34:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:17 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-883438107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b146df82-1512-417e-bd2d-4730ab03759d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0eecffb07e40e2813f1e25408d2790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:34:17Z,use_quota=True,user_id='c7249539ccb64caa9d422323a83818f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:34:17 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Creating volume b146df82-1512-417e-bd2d-4730ab03759d {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:34:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:17 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:34:17 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:34:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:17 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:34:17 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:34:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:17 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d 1073741824 Nov 03 08:34:17 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:17 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d 1073741824" returned: 0 in 0.397s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:17 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d Nov 03 08:34:17 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:17 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d" returned: 0 in 0.238s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:17 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:34:17 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9404ed-614e-48ac-a7c5-aaef36d150da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b146df82-1512-417e-bd2d-4730ab03759d', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ee6c55-0ae8-4d7c-b7d4-55d7e61e8d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:18 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Volume volume-b146df82-1512-417e-bd2d-4730ab03759d (b146df82-1512-417e-bd2d-4730ab03759d): created successfully Nov 03 08:34:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ee6c55-0ae8-4d7c-b7d4-55d7e61e8d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:18 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Flow 'volume_create_manager' (e7a4c086-402f-4865-8c8b-d8a9c991ecd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:34:18 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-127f0bc4-adc1-4d74-a967-a288f1768a87 tempest-ProjectMemberTests-1074109481 None] Created volume successfully. Nov 03 08:34:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b237c97e-329b-4aeb-9382-6dada6f8abe7 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b237c97e-329b-4aeb-9382-6dada6f8abe7 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:18 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-b237c97e-329b-4aeb-9382-6dada6f8abe7 tempest-ProjectMemberTests-1074109481 None] Creating offline snapshot cc0c0aba-e5d9-4a03-83c8-5a67ec44e76f of volume b146df82-1512-417e-bd2d-4730ab03759d {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:34:18 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a9535d-0e5e-46fb-aa80-d9de02cc036e]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b237c97e-329b-4aeb-9382-6dada6f8abe7 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:18 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d Nov 03 08:34:18 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:18 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b237c97e-329b-4aeb-9382-6dada6f8abe7 tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d" returned: 0 in 0.349s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:18 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b237c97e-329b-4aeb-9382-6dada6f8abe7 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d.cc0c0aba-e5d9-4a03-83c8-5a67ec44e76f 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:18 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d.cc0c0aba-e5d9-4a03-83c8-5a67ec44e76f 1G Nov 03 08:34:18 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:19 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b237c97e-329b-4aeb-9382-6dada6f8abe7 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d.cc0c0aba-e5d9-4a03-83c8-5a67ec44e76f 1G" returned: 0 in 0.381s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b237c97e-329b-4aeb-9382-6dada6f8abe7 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b146df82-1512-417e-bd2d-4730ab03759d -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d.cc0c0aba-e5d9-4a03-83c8-5a67ec44e76f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:19 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b146df82-1512-417e-bd2d-4730ab03759d -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d.cc0c0aba-e5d9-4a03-83c8-5a67ec44e76f Nov 03 08:34:19 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:19 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b237c97e-329b-4aeb-9382-6dada6f8abe7 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b146df82-1512-417e-bd2d-4730ab03759d -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d.cc0c0aba-e5d9-4a03-83c8-5a67ec44e76f" returned: 0 in 0.288s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:19 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-b237c97e-329b-4aeb-9382-6dada6f8abe7 tempest-ProjectMemberTests-1074109481 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d.cc0c0aba-e5d9-4a03-83c8-5a67ec44e76f is being set with open permissions: ugo+rw Nov 03 08:34:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b237c97e-329b-4aeb-9382-6dada6f8abe7 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d.cc0c0aba-e5d9-4a03-83c8-5a67ec44e76f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:19 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d.cc0c0aba-e5d9-4a03-83c8-5a67ec44e76f Nov 03 08:34:19 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:19 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b237c97e-329b-4aeb-9382-6dada6f8abe7 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d.cc0c0aba-e5d9-4a03-83c8-5a67ec44e76f" returned: 0 in 0.240s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b237c97e-329b-4aeb-9382-6dada6f8abe7 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:19 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d.info Nov 03 08:34:19 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:19 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b237c97e-329b-4aeb-9382-6dada6f8abe7 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d.info" returned: 0 in 0.245s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:19 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-b237c97e-329b-4aeb-9382-6dada6f8abe7 tempest-ProjectMemberTests-1074109481 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d.info is being set with open permissions: ugo+rw Nov 03 08:34:19 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b237c97e-329b-4aeb-9382-6dada6f8abe7 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:19 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d.info Nov 03 08:34:19 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:20 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-b237c97e-329b-4aeb-9382-6dada6f8abe7 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d.info" returned: 0 in 0.243s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-b237c97e-329b-4aeb-9382-6dada6f8abe7 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.821s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:20 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-b237c97e-329b-4aeb-9382-6dada6f8abe7 tempest-ProjectMemberTests-1074109481 None] Create snapshot completed successfully Nov 03 08:34:20 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-96f7619d-1fc9-4be1-b76a-dfbd7f2ef4b1 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-cc0c0aba-e5d9-4a03-83c8-5a67ec44e76f-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:20 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-96f7619d-1fc9-4be1-b76a-dfbd7f2ef4b1 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-cc0c0aba-e5d9-4a03-83c8-5a67ec44e76f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:20 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-96f7619d-1fc9-4be1-b76a-dfbd7f2ef4b1 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-quobyte-b146df82-1512-417e-bd2d-4730ab03759d" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:20 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-96f7619d-1fc9-4be1-b76a-dfbd7f2ef4b1 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-b146df82-1512-417e-bd2d-4730ab03759d" acquired by "delete_snapshot" :: waited 0.012s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:20 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-96f7619d-1fc9-4be1-b76a-dfbd7f2ef4b1 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-quobyte-cc0c0aba-e5d9-4a03-83c8-5a67ec44e76f" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:20 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-96f7619d-1fc9-4be1-b76a-dfbd7f2ef4b1 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-cc0c0aba-e5d9-4a03-83c8-5a67ec44e76f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-96f7619d-1fc9-4be1-b76a-dfbd7f2ef4b1 tempest-ProjectMemberTests-1074109481 None] Deleting offline snapshot cc0c0aba-e5d9-4a03-83c8-5a67ec44e76f of volume b146df82-1512-417e-bd2d-4730ab03759d {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:34:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-96f7619d-1fc9-4be1-b76a-dfbd7f2ef4b1 tempest-ProjectMemberTests-1074109481 None] snapshot_file for this snap is: volume-b146df82-1512-417e-bd2d-4730ab03759d.cc0c0aba-e5d9-4a03-83c8-5a67ec44e76f {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:34:20 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[5826678c-c61d-4c1b-b64a-5a09088c1ead]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-96f7619d-1fc9-4be1-b76a-dfbd7f2ef4b1 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d.cc0c0aba-e5d9-4a03-83c8-5a67ec44e76f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:20 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d.cc0c0aba-e5d9-4a03-83c8-5a67ec44e76f Nov 03 08:34:20 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:20 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-96f7619d-1fc9-4be1-b76a-dfbd7f2ef4b1 tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d.cc0c0aba-e5d9-4a03-83c8-5a67ec44e76f" returned: 0 in 0.354s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:20 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-96f7619d-1fc9-4be1-b76a-dfbd7f2ef4b1 tempest-ProjectMemberTests-1074109481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b146df82-1512-417e-bd2d-4730ab03759d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:34:20 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c07dd4b-54c7-4144-ac8a-ccb246e0bb09]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:20 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-96f7619d-1fc9-4be1-b76a-dfbd7f2ef4b1 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:21 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d Nov 03 08:34:21 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:21 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-96f7619d-1fc9-4be1-b76a-dfbd7f2ef4b1 tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d" returned: 0 in 0.352s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-96f7619d-1fc9-4be1-b76a-dfbd7f2ef4b1 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d.cc0c0aba-e5d9-4a03-83c8-5a67ec44e76f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:21 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d.cc0c0aba-e5d9-4a03-83c8-5a67ec44e76f Nov 03 08:34:21 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:21 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-96f7619d-1fc9-4be1-b76a-dfbd7f2ef4b1 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d.cc0c0aba-e5d9-4a03-83c8-5a67ec44e76f" returned: 0 in 0.317s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-96f7619d-1fc9-4be1-b76a-dfbd7f2ef4b1 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d.cc0c0aba-e5d9-4a03-83c8-5a67ec44e76f {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:21 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d.cc0c0aba-e5d9-4a03-83c8-5a67ec44e76f Nov 03 08:34:21 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:21 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:21 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-96f7619d-1fc9-4be1-b76a-dfbd7f2ef4b1 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d.cc0c0aba-e5d9-4a03-83c8-5a67ec44e76f" returned: 0 in 0.246s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:21 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-96f7619d-1fc9-4be1-b76a-dfbd7f2ef4b1 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-cc0c0aba-e5d9-4a03-83c8-5a67ec44e76f" released by "_delete_snapshot" :: held 1.363s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:21 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-96f7619d-1fc9-4be1-b76a-dfbd7f2ef4b1 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-b146df82-1512-417e-bd2d-4730ab03759d" released by "delete_snapshot" :: held 1.384s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:21 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-96f7619d-1fc9-4be1-b76a-dfbd7f2ef4b1 tempest-ProjectMemberTests-1074109481 None] Created reservations ['6e1b5295-5f02-4429-a1c0-039ed65b5af9', '885d80f0-04e4-4d28-b6a8-03fc57c14058', '2b625ad5-6079-417a-91ea-2b25f48727c6', '0f3a0c6b-411a-4e73-ac17-2821cd8fc67d'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:34:22 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-96f7619d-1fc9-4be1-b76a-dfbd7f2ef4b1 tempest-ProjectMemberTests-1074109481 None] Delete snapshot completed successfully. Nov 03 08:34:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-96f7619d-1fc9-4be1-b76a-dfbd7f2ef4b1 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-cc0c0aba-e5d9-4a03-83c8-5a67ec44e76f-delete_snapshot" released by "delete_snapshot" :: held 1.508s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5e031c99-e578-42cf-bcb9-6d47532258f6 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-b146df82-1512-417e-bd2d-4730ab03759d-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5e031c99-e578-42cf-bcb9-6d47532258f6 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-b146df82-1512-417e-bd2d-4730ab03759d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5e031c99-e578-42cf-bcb9-6d47532258f6 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-quobyte-b146df82-1512-417e-bd2d-4730ab03759d" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:22 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5e031c99-e578-42cf-bcb9-6d47532258f6 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-b146df82-1512-417e-bd2d-4730ab03759d" acquired by "delete_volume" :: waited 0.023s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:22 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14dda12-5a4b-4229-adc1-cb16f6342584]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:22 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5e031c99-e578-42cf-bcb9-6d47532258f6 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:22 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d Nov 03 08:34:22 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:23 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5e031c99-e578-42cf-bcb9-6d47532258f6 tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d" returned: 0 in 0.350s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5e031c99-e578-42cf-bcb9-6d47532258f6 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:23 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d Nov 03 08:34:23 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:23 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5e031c99-e578-42cf-bcb9-6d47532258f6 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-b146df82-1512-417e-bd2d-4730ab03759d" returned: 0 in 0.233s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:23 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5e031c99-e578-42cf-bcb9-6d47532258f6 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-b146df82-1512-417e-bd2d-4730ab03759d" released by "delete_volume" :: held 0.640s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:23 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-5e031c99-e578-42cf-bcb9-6d47532258f6 tempest-ProjectMemberTests-1074109481 None] Created reservations ['500d351d-57dc-43c9-a106-27a59649439e', 'b5d67918-3f1a-4e90-bfa5-57e34d7eac75', '35a35c47-af1f-469f-8fc1-716ecdcc7bf6', '3c7219bb-4a14-40c6-94ba-808019aea480'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:34:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5e031c99-e578-42cf-bcb9-6d47532258f6 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5e031c99-e578-42cf-bcb9-6d47532258f6 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5e031c99-e578-42cf-bcb9-6d47532258f6 tempest-ProjectMemberTests-1074109481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:34:23 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-5e031c99-e578-42cf-bcb9-6d47532258f6 tempest-ProjectMemberTests-1074109481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:34:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-5e031c99-e578-42cf-bcb9-6d47532258f6 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5e031c99-e578-42cf-bcb9-6d47532258f6 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:23 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:34:23 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:23 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:23 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-5e031c99-e578-42cf-bcb9-6d47532258f6 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.245s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:23 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-5e031c99-e578-42cf-bcb9-6d47532258f6 tempest-ProjectMemberTests-1074109481 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:34:23 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-5e031c99-e578-42cf-bcb9-6d47532258f6 tempest-ProjectMemberTests-1074109481 None] Deleted volume successfully. Nov 03 08:34:23 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-5e031c99-e578-42cf-bcb9-6d47532258f6 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-b146df82-1512-417e-bd2d-4730ab03759d-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:24 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:34:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Flow 'volume_create_manager' (b873a5ea-a90c-46df-8234-3891eaca3bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:34:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e55618-f5f2-4f1a-823b-f344b1b152cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e55618-f5f2-4f1a-823b-f344b1b152cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1656385247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0eecffb07e40e2813f1e25408d2790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:34:24Z,use_quota=True,user_id='c7249539ccb64caa9d422323a83818f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e5fa7d-7fc4-44a4-9499-b913cd1d6746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e5fa7d-7fc4-44a4-9499-b913cd1d6746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e97ce4-35f3-4692-9c4e-893c49a5e991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e97ce4-35f3-4692-9c4e-893c49a5e991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7', 'volume_name': 'volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (809a7613-183a-45b8-ab03-c9c43fe04cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (809a7613-183a-45b8-ab03-c9c43fe04cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:24 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573a40c4-f7ae-4c41-827f-0e463fa11919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:24 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Volume 2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7', 'volume_size': 1} Nov 03 08:34:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1656385247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0eecffb07e40e2813f1e25408d2790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:34:24Z,use_quota=True,user_id='c7249539ccb64caa9d422323a83818f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:34:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Creating volume 2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:34:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:34:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:34:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:34:24 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:34:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:24 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7 1073741824 Nov 03 08:34:24 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:24 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7 1073741824" returned: 0 in 0.404s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:24 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7 Nov 03 08:34:24 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:24 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7" returned: 0 in 0.244s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:24 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:34:24 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573a40c4-f7ae-4c41-827f-0e463fa11919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4638989d-1d40-4f93-9b83-8e67d15f991e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:25 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Volume volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7 (2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7): created successfully Nov 03 08:34:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4638989d-1d40-4f93-9b83-8e67d15f991e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:25 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Flow 'volume_create_manager' (b873a5ea-a90c-46df-8234-3891eaca3bcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:34:25 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-8c263c43-8b05-48e4-923d-bdf6237ff141 tempest-ProjectMemberTests-1074109481 None] Created volume successfully. Nov 03 08:34:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-10a1b9c5-e949-4dca-be71-22d37242a475 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-10a1b9c5-e949-4dca-be71-22d37242a475 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:25 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-10a1b9c5-e949-4dca-be71-22d37242a475 tempest-ProjectMemberTests-1074109481 None] Creating offline snapshot 31b87f88-7ac4-44bd-be29-408f4f2cc70a of volume 2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7 {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:34:25 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fc4e2f-df6f-4c12-bb55-96b7638ec912]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-10a1b9c5-e949-4dca-be71-22d37242a475 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:25 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7 Nov 03 08:34:25 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:25 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-10a1b9c5-e949-4dca-be71-22d37242a475 tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7" returned: 0 in 0.357s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:25 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-10a1b9c5-e949-4dca-be71-22d37242a475 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7.31b87f88-7ac4-44bd-be29-408f4f2cc70a 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:25 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7.31b87f88-7ac4-44bd-be29-408f4f2cc70a 1G Nov 03 08:34:25 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:26 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-10a1b9c5-e949-4dca-be71-22d37242a475 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7.31b87f88-7ac4-44bd-be29-408f4f2cc70a 1G" returned: 0 in 0.380s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-10a1b9c5-e949-4dca-be71-22d37242a475 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7.31b87f88-7ac4-44bd-be29-408f4f2cc70a {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:26 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7.31b87f88-7ac4-44bd-be29-408f4f2cc70a Nov 03 08:34:26 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:26 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-10a1b9c5-e949-4dca-be71-22d37242a475 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7.31b87f88-7ac4-44bd-be29-408f4f2cc70a" returned: 0 in 0.282s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:26 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-10a1b9c5-e949-4dca-be71-22d37242a475 tempest-ProjectMemberTests-1074109481 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7.31b87f88-7ac4-44bd-be29-408f4f2cc70a is being set with open permissions: ugo+rw Nov 03 08:34:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-10a1b9c5-e949-4dca-be71-22d37242a475 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7.31b87f88-7ac4-44bd-be29-408f4f2cc70a {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:26 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7.31b87f88-7ac4-44bd-be29-408f4f2cc70a Nov 03 08:34:26 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:26 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-10a1b9c5-e949-4dca-be71-22d37242a475 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7.31b87f88-7ac4-44bd-be29-408f4f2cc70a" returned: 0 in 0.236s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-10a1b9c5-e949-4dca-be71-22d37242a475 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:26 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7.info Nov 03 08:34:26 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:26 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-10a1b9c5-e949-4dca-be71-22d37242a475 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7.info" returned: 0 in 0.249s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:26 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-10a1b9c5-e949-4dca-be71-22d37242a475 tempest-ProjectMemberTests-1074109481 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7.info is being set with open permissions: ugo+rw Nov 03 08:34:26 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-10a1b9c5-e949-4dca-be71-22d37242a475 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:26 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7.info Nov 03 08:34:26 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:27 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-10a1b9c5-e949-4dca-be71-22d37242a475 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7.info" returned: 0 in 0.234s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-10a1b9c5-e949-4dca-be71-22d37242a475 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.815s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:27 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-10a1b9c5-e949-4dca-be71-22d37242a475 tempest-ProjectMemberTests-1074109481 None] Create snapshot completed successfully Nov 03 08:34:27 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-49e703b7-d699-4b6f-b827-4bc18d45998e tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-31b87f88-7ac4-44bd-be29-408f4f2cc70a-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:27 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-49e703b7-d699-4b6f-b827-4bc18d45998e tempest-ProjectMemberTests-1074109481 None] Lock "cinder-31b87f88-7ac4-44bd-be29-408f4f2cc70a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:27 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-49e703b7-d699-4b6f-b827-4bc18d45998e tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-quobyte-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:27 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-49e703b7-d699-4b6f-b827-4bc18d45998e tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:27 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-49e703b7-d699-4b6f-b827-4bc18d45998e tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-quobyte-31b87f88-7ac4-44bd-be29-408f4f2cc70a" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:27 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-49e703b7-d699-4b6f-b827-4bc18d45998e tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-31b87f88-7ac4-44bd-be29-408f4f2cc70a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-49e703b7-d699-4b6f-b827-4bc18d45998e tempest-ProjectMemberTests-1074109481 None] Deleting offline snapshot 31b87f88-7ac4-44bd-be29-408f4f2cc70a of volume 2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:34:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-49e703b7-d699-4b6f-b827-4bc18d45998e tempest-ProjectMemberTests-1074109481 None] snapshot_file for this snap is: volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7.31b87f88-7ac4-44bd-be29-408f4f2cc70a {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:34:27 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5a3b07-5c4c-4cf5-beb8-3b07c2b25fe2]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-49e703b7-d699-4b6f-b827-4bc18d45998e tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7.31b87f88-7ac4-44bd-be29-408f4f2cc70a {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:27 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7.31b87f88-7ac4-44bd-be29-408f4f2cc70a Nov 03 08:34:27 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:27 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-49e703b7-d699-4b6f-b827-4bc18d45998e tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7.31b87f88-7ac4-44bd-be29-408f4f2cc70a" returned: 0 in 0.356s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:27 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-49e703b7-d699-4b6f-b827-4bc18d45998e tempest-ProjectMemberTests-1074109481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:34:27 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[77117af9-4006-4437-ada8-76400512396e]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:27 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-49e703b7-d699-4b6f-b827-4bc18d45998e tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:28 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7 Nov 03 08:34:28 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:28 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-49e703b7-d699-4b6f-b827-4bc18d45998e tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7" returned: 0 in 0.354s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-49e703b7-d699-4b6f-b827-4bc18d45998e tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7.31b87f88-7ac4-44bd-be29-408f4f2cc70a {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:28 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7.31b87f88-7ac4-44bd-be29-408f4f2cc70a Nov 03 08:34:28 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:28 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-49e703b7-d699-4b6f-b827-4bc18d45998e tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7.31b87f88-7ac4-44bd-be29-408f4f2cc70a" returned: 0 in 0.333s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-49e703b7-d699-4b6f-b827-4bc18d45998e tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7.31b87f88-7ac4-44bd-be29-408f4f2cc70a {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:28 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7.31b87f88-7ac4-44bd-be29-408f4f2cc70a Nov 03 08:34:28 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:28 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:28 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-49e703b7-d699-4b6f-b827-4bc18d45998e tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7.31b87f88-7ac4-44bd-be29-408f4f2cc70a" returned: 0 in 0.251s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:28 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-49e703b7-d699-4b6f-b827-4bc18d45998e tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-31b87f88-7ac4-44bd-be29-408f4f2cc70a" released by "_delete_snapshot" :: held 1.384s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:28 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-49e703b7-d699-4b6f-b827-4bc18d45998e tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7" released by "delete_snapshot" :: held 1.405s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:29 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-49e703b7-d699-4b6f-b827-4bc18d45998e tempest-ProjectMemberTests-1074109481 None] Created reservations ['153af34c-863b-4c75-8190-9418ad05b55f', 'e7676135-2d68-4616-8a69-ae6df4c0dad6', '45fe37a7-d530-4a1e-a11f-fa7596868697', '0fec4213-a569-4443-a5bd-f61c4dc0d852'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:34:29 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-49e703b7-d699-4b6f-b827-4bc18d45998e tempest-ProjectMemberTests-1074109481 None] Delete snapshot completed successfully. Nov 03 08:34:29 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-49e703b7-d699-4b6f-b827-4bc18d45998e tempest-ProjectMemberTests-1074109481 None] Lock "cinder-31b87f88-7ac4-44bd-be29-408f4f2cc70a-delete_snapshot" released by "delete_snapshot" :: held 1.545s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:29 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c1b36dc0-9efb-4ae2-98a9-c52273ea8c6b tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:29 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c1b36dc0-9efb-4ae2-98a9-c52273ea8c6b tempest-ProjectMemberTests-1074109481 None] Lock "cinder-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:29 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c1b36dc0-9efb-4ae2-98a9-c52273ea8c6b tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-quobyte-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:29 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c1b36dc0-9efb-4ae2-98a9-c52273ea8c6b tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7" acquired by "delete_volume" :: waited 0.014s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:29 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f799a04-01f9-41db-83ed-4e7fe687b75b]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:29 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c1b36dc0-9efb-4ae2-98a9-c52273ea8c6b tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:29 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7 Nov 03 08:34:29 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:30 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c1b36dc0-9efb-4ae2-98a9-c52273ea8c6b tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7" returned: 0 in 0.361s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c1b36dc0-9efb-4ae2-98a9-c52273ea8c6b tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:30 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7 Nov 03 08:34:30 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:30 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c1b36dc0-9efb-4ae2-98a9-c52273ea8c6b tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7" returned: 0 in 0.248s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:30 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c1b36dc0-9efb-4ae2-98a9-c52273ea8c6b tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7" released by "delete_volume" :: held 0.664s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:30 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-c1b36dc0-9efb-4ae2-98a9-c52273ea8c6b tempest-ProjectMemberTests-1074109481 None] Created reservations ['8f0e6df9-6aa4-49f1-82b3-8c86b1fd6e1a', 'e7b248a8-5dfd-4f26-8950-42b37887b86f', '91109284-e5d8-4b05-8ce1-f6bea2fd6b7f', 'c05cbed2-d1b8-496f-a714-04ab09b06037'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:34:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c1b36dc0-9efb-4ae2-98a9-c52273ea8c6b tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c1b36dc0-9efb-4ae2-98a9-c52273ea8c6b tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c1b36dc0-9efb-4ae2-98a9-c52273ea8c6b tempest-ProjectMemberTests-1074109481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:34:30 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c1b36dc0-9efb-4ae2-98a9-c52273ea8c6b tempest-ProjectMemberTests-1074109481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:34:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c1b36dc0-9efb-4ae2-98a9-c52273ea8c6b tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c1b36dc0-9efb-4ae2-98a9-c52273ea8c6b tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:30 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:34:30 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:30 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:30 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c1b36dc0-9efb-4ae2-98a9-c52273ea8c6b tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.239s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:30 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-c1b36dc0-9efb-4ae2-98a9-c52273ea8c6b tempest-ProjectMemberTests-1074109481 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:34:30 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-c1b36dc0-9efb-4ae2-98a9-c52273ea8c6b tempest-ProjectMemberTests-1074109481 None] Deleted volume successfully. Nov 03 08:34:30 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-c1b36dc0-9efb-4ae2-98a9-c52273ea8c6b tempest-ProjectMemberTests-1074109481 None] Lock "cinder-2ca6c89d-a8cb-4661-8eb8-5d42a96c89b7-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Flow 'volume_create_manager' (720803eb-5ea4-49e7-9413-82ce9c2a8a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f3c992-f3f6-4b74-b908-f85b17f68ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f3c992-f3f6-4b74-b908-f85b17f68ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-131281850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde44b68-f870-40f7-97bf-ce8a4c88749a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0eecffb07e40e2813f1e25408d2790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:34:31Z,use_quota=True,user_id='c7249539ccb64caa9d422323a83818f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22be6ad7-efeb-49d6-aa41-ef91bef7a158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22be6ad7-efeb-49d6-aa41-ef91bef7a158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b99e047-110b-44d3-9d0e-6c9879d0a0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b99e047-110b-44d3-9d0e-6c9879d0a0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bde44b68-f870-40f7-97bf-ce8a4c88749a', 'volume_name': 'volume-bde44b68-f870-40f7-97bf-ce8a4c88749a', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (508c66f6-fcf5-4109-be40-adc78999d166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (508c66f6-fcf5-4109-be40-adc78999d166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c24d01-e6f1-4617-8b89-e08d53babe24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:31 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Volume bde44b68-f870-40f7-97bf-ce8a4c88749a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bde44b68-f870-40f7-97bf-ce8a4c88749a', 'volume_size': 1} Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-131281850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde44b68-f870-40f7-97bf-ce8a4c88749a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0eecffb07e40e2813f1e25408d2790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:34:31Z,use_quota=True,user_id='c7249539ccb64caa9d422323a83818f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Creating volume bde44b68-f870-40f7-97bf-ce8a4c88749a {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:34:31 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:31 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a 1073741824 Nov 03 08:34:31 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:31 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a 1073741824" returned: 0 in 0.395s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:31 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a Nov 03 08:34:31 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:31 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a" returned: 0 in 0.238s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c24d01-e6f1-4617-8b89-e08d53babe24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bde44b68-f870-40f7-97bf-ce8a4c88749a', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:31 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b89b9e-8db5-4e5c-b52e-e428947c1b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:32 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Volume volume-bde44b68-f870-40f7-97bf-ce8a4c88749a (bde44b68-f870-40f7-97bf-ce8a4c88749a): created successfully Nov 03 08:34:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b89b9e-8db5-4e5c-b52e-e428947c1b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:32 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Flow 'volume_create_manager' (720803eb-5ea4-49e7-9413-82ce9c2a8a29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:34:32 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-a44757e7-e4bf-4e4e-8a31-393cff12252d tempest-ProjectMemberTests-1074109481 None] Created volume successfully. Nov 03 08:34:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3ed06a21-ed83-4851-baa2-9b0b126a10fc tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3ed06a21-ed83-4851-baa2-9b0b126a10fc tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:32 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-3ed06a21-ed83-4851-baa2-9b0b126a10fc tempest-ProjectMemberTests-1074109481 None] Creating offline snapshot 24012d92-fb04-463f-870d-753a90ffd312 of volume bde44b68-f870-40f7-97bf-ce8a4c88749a {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:34:32 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5c9e84-3c6a-4607-b47e-0fda0d43f2b0]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3ed06a21-ed83-4851-baa2-9b0b126a10fc tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:32 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a Nov 03 08:34:32 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:32 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3ed06a21-ed83-4851-baa2-9b0b126a10fc tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a" returned: 0 in 0.347s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:32 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3ed06a21-ed83-4851-baa2-9b0b126a10fc tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a.24012d92-fb04-463f-870d-753a90ffd312 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:32 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a.24012d92-fb04-463f-870d-753a90ffd312 1G Nov 03 08:34:32 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:33 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3ed06a21-ed83-4851-baa2-9b0b126a10fc tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a.24012d92-fb04-463f-870d-753a90ffd312 1G" returned: 0 in 0.374s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3ed06a21-ed83-4851-baa2-9b0b126a10fc tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bde44b68-f870-40f7-97bf-ce8a4c88749a -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a.24012d92-fb04-463f-870d-753a90ffd312 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:33 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bde44b68-f870-40f7-97bf-ce8a4c88749a -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a.24012d92-fb04-463f-870d-753a90ffd312 Nov 03 08:34:33 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:33 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3ed06a21-ed83-4851-baa2-9b0b126a10fc tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bde44b68-f870-40f7-97bf-ce8a4c88749a -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a.24012d92-fb04-463f-870d-753a90ffd312" returned: 0 in 0.292s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:33 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-3ed06a21-ed83-4851-baa2-9b0b126a10fc tempest-ProjectMemberTests-1074109481 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a.24012d92-fb04-463f-870d-753a90ffd312 is being set with open permissions: ugo+rw Nov 03 08:34:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3ed06a21-ed83-4851-baa2-9b0b126a10fc tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a.24012d92-fb04-463f-870d-753a90ffd312 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:33 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a.24012d92-fb04-463f-870d-753a90ffd312 Nov 03 08:34:33 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:33 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3ed06a21-ed83-4851-baa2-9b0b126a10fc tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a.24012d92-fb04-463f-870d-753a90ffd312" returned: 0 in 0.232s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3ed06a21-ed83-4851-baa2-9b0b126a10fc tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:33 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a.info Nov 03 08:34:33 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:33 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3ed06a21-ed83-4851-baa2-9b0b126a10fc tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a.info" returned: 0 in 0.242s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:33 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-3ed06a21-ed83-4851-baa2-9b0b126a10fc tempest-ProjectMemberTests-1074109481 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a.info is being set with open permissions: ugo+rw Nov 03 08:34:33 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3ed06a21-ed83-4851-baa2-9b0b126a10fc tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:33 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a.info Nov 03 08:34:33 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:34 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-3ed06a21-ed83-4851-baa2-9b0b126a10fc tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a.info" returned: 0 in 0.231s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-3ed06a21-ed83-4851-baa2-9b0b126a10fc tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.795s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:34 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-3ed06a21-ed83-4851-baa2-9b0b126a10fc tempest-ProjectMemberTests-1074109481 None] Create snapshot completed successfully Nov 03 08:34:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-914eaf06-0dbe-433c-a8db-9b28cabc9681 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-24012d92-fb04-463f-870d-753a90ffd312-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-914eaf06-0dbe-433c-a8db-9b28cabc9681 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-24012d92-fb04-463f-870d-753a90ffd312-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-914eaf06-0dbe-433c-a8db-9b28cabc9681 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-quobyte-bde44b68-f870-40f7-97bf-ce8a4c88749a" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-914eaf06-0dbe-433c-a8db-9b28cabc9681 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-bde44b68-f870-40f7-97bf-ce8a4c88749a" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-914eaf06-0dbe-433c-a8db-9b28cabc9681 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-quobyte-24012d92-fb04-463f-870d-753a90ffd312" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:34 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-914eaf06-0dbe-433c-a8db-9b28cabc9681 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-24012d92-fb04-463f-870d-753a90ffd312" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:34 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-914eaf06-0dbe-433c-a8db-9b28cabc9681 tempest-ProjectMemberTests-1074109481 None] Deleting offline snapshot 24012d92-fb04-463f-870d-753a90ffd312 of volume bde44b68-f870-40f7-97bf-ce8a4c88749a {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:34:34 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-914eaf06-0dbe-433c-a8db-9b28cabc9681 tempest-ProjectMemberTests-1074109481 None] snapshot_file for this snap is: volume-bde44b68-f870-40f7-97bf-ce8a4c88749a.24012d92-fb04-463f-870d-753a90ffd312 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:34:34 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[118c9342-6176-4cb4-a03f-d19dc3e222c6]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-914eaf06-0dbe-433c-a8db-9b28cabc9681 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a.24012d92-fb04-463f-870d-753a90ffd312 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:34 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a.24012d92-fb04-463f-870d-753a90ffd312 Nov 03 08:34:34 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:34 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-914eaf06-0dbe-433c-a8db-9b28cabc9681 tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a.24012d92-fb04-463f-870d-753a90ffd312" returned: 0 in 0.358s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:34 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-914eaf06-0dbe-433c-a8db-9b28cabc9681 tempest-ProjectMemberTests-1074109481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bde44b68-f870-40f7-97bf-ce8a4c88749a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:34:34 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[e569bffc-b7e4-4fef-93b8-53095189a719]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:34 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-914eaf06-0dbe-433c-a8db-9b28cabc9681 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:35 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a Nov 03 08:34:35 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:35 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-914eaf06-0dbe-433c-a8db-9b28cabc9681 tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a" returned: 0 in 0.357s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-914eaf06-0dbe-433c-a8db-9b28cabc9681 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a.24012d92-fb04-463f-870d-753a90ffd312 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:35 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a.24012d92-fb04-463f-870d-753a90ffd312 Nov 03 08:34:35 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:35 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-914eaf06-0dbe-433c-a8db-9b28cabc9681 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a.24012d92-fb04-463f-870d-753a90ffd312" returned: 0 in 0.332s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-914eaf06-0dbe-433c-a8db-9b28cabc9681 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a.24012d92-fb04-463f-870d-753a90ffd312 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:35 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a.24012d92-fb04-463f-870d-753a90ffd312 Nov 03 08:34:35 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:35 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:35 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-914eaf06-0dbe-433c-a8db-9b28cabc9681 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a.24012d92-fb04-463f-870d-753a90ffd312" returned: 0 in 0.238s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-914eaf06-0dbe-433c-a8db-9b28cabc9681 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-24012d92-fb04-463f-870d-753a90ffd312" released by "_delete_snapshot" :: held 1.372s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:35 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-914eaf06-0dbe-433c-a8db-9b28cabc9681 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-bde44b68-f870-40f7-97bf-ce8a4c88749a" released by "delete_snapshot" :: held 1.392s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:35 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-914eaf06-0dbe-433c-a8db-9b28cabc9681 tempest-ProjectMemberTests-1074109481 None] Created reservations ['13de72ae-9fdb-48f6-b40b-2d8dcfc720f3', '782ef10b-324d-4a92-864e-838b9b33d9a0', 'fa381fdb-8e27-46c0-938c-78f82c0ca2d2', '71581d4b-edeb-426e-9942-82ceca172360'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:34:36 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-914eaf06-0dbe-433c-a8db-9b28cabc9681 tempest-ProjectMemberTests-1074109481 None] Delete snapshot completed successfully. Nov 03 08:34:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-914eaf06-0dbe-433c-a8db-9b28cabc9681 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-24012d92-fb04-463f-870d-753a90ffd312-delete_snapshot" released by "delete_snapshot" :: held 1.521s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-07a28451-1a8b-4e50-bf4a-145ff471dc3d tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-bde44b68-f870-40f7-97bf-ce8a4c88749a-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-07a28451-1a8b-4e50-bf4a-145ff471dc3d tempest-ProjectMemberTests-1074109481 None] Lock "cinder-bde44b68-f870-40f7-97bf-ce8a4c88749a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-07a28451-1a8b-4e50-bf4a-145ff471dc3d tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-quobyte-bde44b68-f870-40f7-97bf-ce8a4c88749a" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:36 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-07a28451-1a8b-4e50-bf4a-145ff471dc3d tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-bde44b68-f870-40f7-97bf-ce8a4c88749a" acquired by "delete_volume" :: waited 0.016s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:36 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bacbe8-9760-4620-98d8-c32f0feebfe2]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:36 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-07a28451-1a8b-4e50-bf4a-145ff471dc3d tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:36 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a Nov 03 08:34:36 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:37 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-07a28451-1a8b-4e50-bf4a-145ff471dc3d tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a" returned: 0 in 0.336s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-07a28451-1a8b-4e50-bf4a-145ff471dc3d tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:37 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a Nov 03 08:34:37 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:37 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-07a28451-1a8b-4e50-bf4a-145ff471dc3d tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-bde44b68-f870-40f7-97bf-ce8a4c88749a" returned: 0 in 0.240s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-07a28451-1a8b-4e50-bf4a-145ff471dc3d tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-bde44b68-f870-40f7-97bf-ce8a4c88749a" released by "delete_volume" :: held 0.632s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:37 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-07a28451-1a8b-4e50-bf4a-145ff471dc3d tempest-ProjectMemberTests-1074109481 None] Created reservations ['616d9553-d69c-4750-8558-b074bf189701', 'cc04bfc6-2935-459d-a438-18974573fafb', '0bedfa94-310f-498a-9335-6bd54edd66c7', '6a97fbad-0c1e-40dd-a7fb-26791bc55020'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:34:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-07a28451-1a8b-4e50-bf4a-145ff471dc3d tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-07a28451-1a8b-4e50-bf4a-145ff471dc3d tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-07a28451-1a8b-4e50-bf4a-145ff471dc3d tempest-ProjectMemberTests-1074109481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:34:37 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-07a28451-1a8b-4e50-bf4a-145ff471dc3d tempest-ProjectMemberTests-1074109481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:34:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-07a28451-1a8b-4e50-bf4a-145ff471dc3d tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-07a28451-1a8b-4e50-bf4a-145ff471dc3d tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:37 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:34:37 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:37 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:37 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-07a28451-1a8b-4e50-bf4a-145ff471dc3d tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.240s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:37 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-07a28451-1a8b-4e50-bf4a-145ff471dc3d tempest-ProjectMemberTests-1074109481 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:34:37 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-07a28451-1a8b-4e50-bf4a-145ff471dc3d tempest-ProjectMemberTests-1074109481 None] Deleted volume successfully. Nov 03 08:34:37 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-07a28451-1a8b-4e50-bf4a-145ff471dc3d tempest-ProjectMemberTests-1074109481 None] Lock "cinder-bde44b68-f870-40f7-97bf-ce8a4c88749a-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86801) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Flow 'volume_create_manager' (4f806929-3089-4180-9192-807b10866f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e5dcde-1d7a-4051-911d-3e2652ec69d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e5dcde-1d7a-4051-911d-3e2652ec69d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-337839847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f6e9b80-6e03-485f-bc33-9006cb02aea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0eecffb07e40e2813f1e25408d2790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:34:38Z,use_quota=True,user_id='c7249539ccb64caa9d422323a83818f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63f7880d-08f8-448e-9226-c04862eb7bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63f7880d-08f8-448e-9226-c04862eb7bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (183bbd4d-9863-4257-8599-1d383f490ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (183bbd4d-9863-4257-8599-1d383f490ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f6e9b80-6e03-485f-bc33-9006cb02aea3', 'volume_name': 'volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fff70cb-cc30-4875-9120-d473b5a6fe82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fff70cb-cc30-4875-9120-d473b5a6fe82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (485f029f-07dc-4152-91fb-a2fcca978b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:38 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Volume 6f6e9b80-6e03-485f-bc33-9006cb02aea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3', 'volume_size': 1} Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T07:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-337839847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f6e9b80-6e03-485f-bc33-9006cb02aea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0eecffb07e40e2813f1e25408d2790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T07:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T07:34:38Z,use_quota=True,user_id='c7249539ccb64caa9d422323a83818f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe5dec65-8f40-415e-8255-f19d4c70d3b1),volume_type_id=fe5dec65-8f40-415e-8255-f19d4c70d3b1)}" {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Creating volume 6f6e9b80-6e03-485f-bc33-9006cb02aea3 {{(pid=86801) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Selected osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f as target Quobyte volume. {{(pid=86801) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 08:34:38 devstack cinder-volume[86801]: INFO cinder.volume.drivers.remotefs [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] casted to osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3 1073741824 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:38 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3 1073741824 Nov 03 08:34:38 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:38 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3 1073741824" returned: 0 in 0.393s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:38 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3 Nov 03 08:34:38 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:38 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3" returned: 0 in 0.237s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'} {{(pid=86801) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (485f029f-07dc-4152-91fb-a2fcca978b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3', 'volume_size': 1}' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c2538c-314b-4d40-87ba-bfa5fd6242f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 08:34:38 devstack cinder-volume[86801]: INFO cinder.volume.flows.manager.create_volume [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Volume volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3 (6f6e9b80-6e03-485f-bc33-9006cb02aea3): created successfully Nov 03 08:34:38 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c2538c-314b-4d40-87ba-bfa5fd6242f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86801) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 08:34:39 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Flow 'volume_create_manager' (4f806929-3089-4180-9192-807b10866f38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86801) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 08:34:39 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-c6df617d-b05f-445b-bfdb-67f16e7f7853 tempest-ProjectMemberTests-1074109481 None] Created volume successfully. Nov 03 08:34:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a877143c-1edf-4a23-ac60-c4727ec8209c tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a877143c-1edf-4a23-ac60-c4727ec8209c tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:39 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-a877143c-1edf-4a23-ac60-c4727ec8209c tempest-ProjectMemberTests-1074109481 None] Creating offline snapshot 31019ddd-1229-4e47-a6dc-3ad93978d322 of volume 6f6e9b80-6e03-485f-bc33-9006cb02aea3 {{(pid=86801) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 08:34:39 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc450d6a-25c5-45f5-98a7-ba743e86e925]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a877143c-1edf-4a23-ac60-c4727ec8209c tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:39 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3 Nov 03 08:34:39 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:39 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a877143c-1edf-4a23-ac60-c4727ec8209c tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3" returned: 0 in 0.348s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:39 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a877143c-1edf-4a23-ac60-c4727ec8209c tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3.31019ddd-1229-4e47-a6dc-3ad93978d322 1G {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:39 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3.31019ddd-1229-4e47-a6dc-3ad93978d322 1G Nov 03 08:34:39 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:40 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a877143c-1edf-4a23-ac60-c4727ec8209c tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3.31019ddd-1229-4e47-a6dc-3ad93978d322 1G" returned: 0 in 0.365s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a877143c-1edf-4a23-ac60-c4727ec8209c tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3.31019ddd-1229-4e47-a6dc-3ad93978d322 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:40 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3.31019ddd-1229-4e47-a6dc-3ad93978d322 Nov 03 08:34:40 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:40 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a877143c-1edf-4a23-ac60-c4727ec8209c tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3 -F qcow2 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3.31019ddd-1229-4e47-a6dc-3ad93978d322" returned: 0 in 0.275s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:40 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-a877143c-1edf-4a23-ac60-c4727ec8209c tempest-ProjectMemberTests-1074109481 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3.31019ddd-1229-4e47-a6dc-3ad93978d322 is being set with open permissions: ugo+rw Nov 03 08:34:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a877143c-1edf-4a23-ac60-c4727ec8209c tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3.31019ddd-1229-4e47-a6dc-3ad93978d322 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:40 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3.31019ddd-1229-4e47-a6dc-3ad93978d322 Nov 03 08:34:40 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:40 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a877143c-1edf-4a23-ac60-c4727ec8209c tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3.31019ddd-1229-4e47-a6dc-3ad93978d322" returned: 0 in 0.238s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a877143c-1edf-4a23-ac60-c4727ec8209c tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:40 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3.info Nov 03 08:34:40 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:40 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a877143c-1edf-4a23-ac60-c4727ec8209c tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3.info" returned: 0 in 0.239s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:40 devstack cinder-volume[86801]: WARNING cinder.volume.drivers.remotefs [None req-a877143c-1edf-4a23-ac60-c4727ec8209c tempest-ProjectMemberTests-1074109481 None] /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3.info is being set with open permissions: ugo+rw Nov 03 08:34:40 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a877143c-1edf-4a23-ac60-c4727ec8209c tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3.info {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:40 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3.info Nov 03 08:34:40 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:41 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-a877143c-1edf-4a23-ac60-c4727ec8209c tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3.info" returned: 0 in 0.230s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-a877143c-1edf-4a23-ac60-c4727ec8209c tempest-ProjectMemberTests-1074109481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.770s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:41 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-a877143c-1edf-4a23-ac60-c4727ec8209c tempest-ProjectMemberTests-1074109481 None] Create snapshot completed successfully Nov 03 08:34:41 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-155f05ba-e75c-401b-b5af-ffe82494378c tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-31019ddd-1229-4e47-a6dc-3ad93978d322-delete_snapshot" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:41 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-155f05ba-e75c-401b-b5af-ffe82494378c tempest-ProjectMemberTests-1074109481 None] Lock "cinder-31019ddd-1229-4e47-a6dc-3ad93978d322-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:41 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-155f05ba-e75c-401b-b5af-ffe82494378c tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-quobyte-6f6e9b80-6e03-485f-bc33-9006cb02aea3" by "delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:41 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-155f05ba-e75c-401b-b5af-ffe82494378c tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-6f6e9b80-6e03-485f-bc33-9006cb02aea3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:41 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-155f05ba-e75c-401b-b5af-ffe82494378c tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-quobyte-31019ddd-1229-4e47-a6dc-3ad93978d322" by "_delete_snapshot" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:41 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-155f05ba-e75c-401b-b5af-ffe82494378c tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-31019ddd-1229-4e47-a6dc-3ad93978d322" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-155f05ba-e75c-401b-b5af-ffe82494378c tempest-ProjectMemberTests-1074109481 None] Deleting offline snapshot 31019ddd-1229-4e47-a6dc-3ad93978d322 of volume 6f6e9b80-6e03-485f-bc33-9006cb02aea3 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 08:34:41 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-155f05ba-e75c-401b-b5af-ffe82494378c tempest-ProjectMemberTests-1074109481 None] snapshot_file for this snap is: volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3.31019ddd-1229-4e47-a6dc-3ad93978d322 {{(pid=86801) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 08:34:41 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4d6b56-bddc-4023-8967-0ae8b768fd38]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:41 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-155f05ba-e75c-401b-b5af-ffe82494378c tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3.31019ddd-1229-4e47-a6dc-3ad93978d322 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:41 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3.31019ddd-1229-4e47-a6dc-3ad93978d322 Nov 03 08:34:41 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:42 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-155f05ba-e75c-401b-b5af-ffe82494378c tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3.31019ddd-1229-4e47-a6dc-3ad93978d322" returned: 0 in 0.346s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:42 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.remotefs [None req-155f05ba-e75c-401b-b5af-ffe82494378c tempest-ProjectMemberTests-1074109481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86801) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 08:34:42 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8e9e8b-fa95-4999-bffb-4cb08a0177b8]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-155f05ba-e75c-401b-b5af-ffe82494378c tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:42 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3 Nov 03 08:34:42 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:42 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-155f05ba-e75c-401b-b5af-ffe82494378c tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3" returned: 0 in 0.342s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-155f05ba-e75c-401b-b5af-ffe82494378c tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3.31019ddd-1229-4e47-a6dc-3ad93978d322 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:42 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3.31019ddd-1229-4e47-a6dc-3ad93978d322 Nov 03 08:34:42 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:42 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-155f05ba-e75c-401b-b5af-ffe82494378c tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3.31019ddd-1229-4e47-a6dc-3ad93978d322" returned: 0 in 0.325s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-155f05ba-e75c-401b-b5af-ffe82494378c tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3.31019ddd-1229-4e47-a6dc-3ad93978d322 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:42 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3.31019ddd-1229-4e47-a6dc-3ad93978d322 Nov 03 08:34:42 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:42 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:42 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-155f05ba-e75c-401b-b5af-ffe82494378c tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3.31019ddd-1229-4e47-a6dc-3ad93978d322" returned: 0 in 0.236s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-155f05ba-e75c-401b-b5af-ffe82494378c tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-31019ddd-1229-4e47-a6dc-3ad93978d322" released by "_delete_snapshot" :: held 1.333s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:42 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-155f05ba-e75c-401b-b5af-ffe82494378c tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-6f6e9b80-6e03-485f-bc33-9006cb02aea3" released by "delete_snapshot" :: held 1.354s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:43 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-155f05ba-e75c-401b-b5af-ffe82494378c tempest-ProjectMemberTests-1074109481 None] Created reservations ['92f7d7f0-403b-4be8-8b77-c01673138d2e', '767b1508-6dd7-4e8d-9e01-bad1d5ffc6c8', '106a8a6f-d724-4b8d-b81e-401c32e7ce04', '6f10ed02-fcb8-4648-87f1-922306451c8d'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:34:43 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-155f05ba-e75c-401b-b5af-ffe82494378c tempest-ProjectMemberTests-1074109481 None] Delete snapshot completed successfully. Nov 03 08:34:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-155f05ba-e75c-401b-b5af-ffe82494378c tempest-ProjectMemberTests-1074109481 None] Lock "cinder-31019ddd-1229-4e47-a6dc-3ad93978d322-delete_snapshot" released by "delete_snapshot" :: held 1.478s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-46c0a68d-ad76-4eea-85ad-e7cce9be6f53 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-6f6e9b80-6e03-485f-bc33-9006cb02aea3-delete_volume" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-46c0a68d-ad76-4eea-85ad-e7cce9be6f53 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-6f6e9b80-6e03-485f-bc33-9006cb02aea3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-46c0a68d-ad76-4eea-85ad-e7cce9be6f53 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "cinder-quobyte-6f6e9b80-6e03-485f-bc33-9006cb02aea3" by "delete_volume" {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 08:34:43 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-46c0a68d-ad76-4eea-85ad-e7cce9be6f53 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-6f6e9b80-6e03-485f-bc33-9006cb02aea3" acquired by "delete_volume" :: waited 0.016s {{(pid=86801) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 08:34:43 devstack cinder-volume[86801]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccc9a24-3911-417d-97b6-6f6a683c51d5]: (4, 'qcow2') {{(pid=88489) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 08:34:43 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-46c0a68d-ad76-4eea-85ad-e7cce9be6f53 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:43 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3 Nov 03 08:34:43 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:44 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-46c0a68d-ad76-4eea-85ad-e7cce9be6f53 tempest-ProjectMemberTests-1074109481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3" returned: 0 in 0.343s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-46c0a68d-ad76-4eea-85ad-e7cce9be6f53 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3 {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:44 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3 Nov 03 08:34:44 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:44 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-46c0a68d-ad76-4eea-85ad-e7cce9be6f53 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba/volume-6f6e9b80-6e03-485f-bc33-9006cb02aea3" returned: 0 in 0.239s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-46c0a68d-ad76-4eea-85ad-e7cce9be6f53 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-quobyte-6f6e9b80-6e03-485f-bc33-9006cb02aea3" released by "delete_volume" :: held 0.639s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:44 devstack cinder-volume[86801]: DEBUG cinder.quota [None req-46c0a68d-ad76-4eea-85ad-e7cce9be6f53 tempest-ProjectMemberTests-1074109481 None] Created reservations ['c8bfd822-232a-43e8-a7c0-7345a21537b7', '60e1006d-6201-494b-b173-b0a1dbc59d1e', '8c7d594c-b15a-4676-8d50-32d3f90bf7d8', 'bc70d1b4-0160-4025-9b8d-a82f990eae8b'] {{(pid=86801) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 08:34:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-46c0a68d-ad76-4eea-85ad-e7cce9be6f53 tempest-ProjectMemberTests-1074109481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:34:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-46c0a68d-ad76-4eea-85ad-e7cce9be6f53 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:34:44 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-46c0a68d-ad76-4eea-85ad-e7cce9be6f53 tempest-ProjectMemberTests-1074109481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:34:44 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-46c0a68d-ad76-4eea-85ad-e7cce9be6f53 tempest-ProjectMemberTests-1074109481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:34:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-46c0a68d-ad76-4eea-85ad-e7cce9be6f53 tempest-ProjectMemberTests-1074109481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:34:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-46c0a68d-ad76-4eea-85ad-e7cce9be6f53 tempest-ProjectMemberTests-1074109481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:34:44 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:34:44 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:34:44 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Nov 03 08:34:44 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-46c0a68d-ad76-4eea-85ad-e7cce9be6f53 tempest-ProjectMemberTests-1074109481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.237s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:34:44 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-46c0a68d-ad76-4eea-85ad-e7cce9be6f53 tempest-ProjectMemberTests-1074109481 None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:34:44 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-46c0a68d-ad76-4eea-85ad-e7cce9be6f53 tempest-ProjectMemberTests-1074109481 None] Deleted volume successfully. Nov 03 08:34:44 devstack cinder-volume[86801]: DEBUG cinder.coordination [None req-46c0a68d-ad76-4eea-85ad-e7cce9be6f53 tempest-ProjectMemberTests-1074109481 None] Lock "cinder-6f6e9b80-6e03-485f-bc33-9006cb02aea3-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=86801) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 08:34:57 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:UPDATE=100,cinder:SELECT=69,cinder:DELETE=5,cinder:INSERT=31 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:34:57 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writing DB stats cinder:SELECT=78,cinder:INSERT=23,cinder:UPDATE=96,cinder:DELETE=11 {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 08:35:03 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:35:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 08:35:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 08:35:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f': None} {{(pid=86801) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 08:35:03 devstack cinder-volume[86801]: DEBUG cinder.volume.drivers.quobyte [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7f37254b-8dad-449e-8b9f-1ee15013f98f'] {{(pid=86801) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 08:35:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86801) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 08:35:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 08:35:03 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba Nov 03 08:35:03 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 08:35:03 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Nov 03 08:35:03 devstack cinder-volume[86801]: DEBUG oslo_concurrency.processutils [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c61a8888e32f037a53505548f6f06ba" returned: 0 in 0.240s {{(pid=86801) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 08:35:03 devstack cinder-volume[86801]: DEBUG cinder.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Notifying Schedulers of capabilities ... {{(pid=86801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 08:35:03 devstack cinder-volume[86801]: DEBUG oslo_service.periodic_task [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] Running periodic task VolumeManager._thread_info {{(pid=86801) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 08:35:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread count: 29 {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 08:35:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-d04608d0-2165-4e00-92a4-10c890ba62ac None None] thread info: [<_MainThread(MainThread, started 139707544170624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86801) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}